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EXECUTIVE  SUMMARY 

To  warrant  satisfactory  unmanned  aerial  vehicle  flight  and  performance,  despite  the 
presence  of  actuator/engine  faults  and  failures,  which  are  bound  to  occur  in  adversarial  f 
and  complex  environments,  there  is  a  need  to  develop  fault/failure  detection  and  recovery 
•  Systems.  This  is  especially  critical  to  ensure  mission  success,  and  more  importantly, 
safety  of  civilian  and  military  personnel,  This  report  investigates  several  techniques  of 
fault/failure  detection  and  recovery  suitable  for  small-scale  unmanned  aerial  vehicles. 

;  SOMMAIRE 

Pour  garantir  le  vol  et  la  performance  de  vehicules  drones,  malgre  la  presence  de  fautes  et 
de  pannes  des  actionneurs  et  moteurs,  qui  peuvent  survenir  lors  de  missions  dans  des 
environnements  complexes,  il  est  necessaire  de  developper  des  systemies  de  detection  de 
fautes/pannes  et  de  recouvrement.  Cela  est  essentiel  pour  assurer  le  succes  de  la  mission, 
et  revet  une  tres  grande  importance  .pour  la  securite  des  civils  et  des  militaries.  Ce  rapport 
etudie  differentes  techniques  de  detection  de  fautes/pannes  et  de  recouvrement  qui  sont 
applicables  aux  drone  de  petites  dimensions. 


ABSTRACT 


In  order  to  avoid  adverse  consequences  due  to  failures,  it  is  desirable  to  have  an  advanced 
failure  detection  and  isolation  (FDI)  system  that  detects  and  identifies  anomalies  early  to 
minimize  the  damage,  and  that  can  remedy  as  many  failures  as  possible.  In  complex 
systems,  fault  diagnosis  is  typically  accomplished  using  a  hierarchical  approach.  In  our 
proposed  autonomous  unmanned  vehicle  (UAV)  system,  fault  diagnosis,  isolation  and 
recovery  (FDIR)  is  accomplished  by  using  a  hierarchical  and  decentralized  approach:  At 
.this  level  of  the  hierarchy  the  model  based  or  analytical  redundancy  based  approach  to 
FDIR  would  require  a  mathematical  model  of  the  process  or  sub-process  under 
consideration.  Based  on  this  knowledge  quantities  called  residuals  will  be  generated.  The 
residuals  should  be  small  Or  close  to  zero  when  there  are  no  failures  in  the  system.  On  the 
other  hand,  they  should  become  nonzero  and  grow  large  if  there  are  malfunctions  in  the 
system.  This  will  accomplish  the  failure  detection.  The  next  important  task  will  be  the 
design  of  a  fault  isolation  module  that  would  isolate  the  faulty  components  or  subsystems. 
There  are  two  major  approaches  to  the  design  and  implementation  of  recovery  procedures, 
One  is  to  synthesize  the  procedures  for  every  possible  failure  mode  at  the  design  stage. 
Once  the  diagnostic  and  recovery  system  is  activated,  it  monitors  the  system  and  if  it 
detects  a  failure,  then  the  system  will  initiate  the  appropriate  recovery  procedure.  In  the 
other  approach,  suitable  recovery  procedures  are  generated  ’’on-line”  upon  the  detection 
of  failures.  In  this  report,  we  will  examine  the  advantages  and  drawbacks  of  the  above 
approaches  in  our  framework. 

RESUME 

Pour  eviter  les  consequences  nefastes  dues  aux  fautes,  il  est  souhaitable  de  developper  urn 
systeme  de  detection  et  d’isolation  de  pannes  qui  detecte  et  identifie  les  anomalies 
suffisarhment  rapidement  pour  minimiser  les  dommages.  Le  diagnostique  des  fautes  est 
generalement  realise  par  le  biais  d’une  approche  hierarchique  pour  des  systemes 
complexes.  Pour  le  systeme  de  drone  propose,  le  diagnostique,  f  isolation  et  le 
recouvrement  (FDIR)  repose  sur  une  approche  decentralisee  ef hierarchique.  L’approche 
analytique  de  FDIR  requiert  un  modele  mathematique  du  drone.  Le  modele  utilise  permet 
de  generer  les  residuels.  D’une  part,  les  residuels  orit  une  valeur  proche  de  zero  lorsque  le 
systeme  est  exempt  de  panne.  D’autre  part,  les  residuels  ont  une  magnitude  non- 
negligeable  lorsque  des  anomalies  se  presentent  au  sein  du  systeme.  La  generation  des 
residuels  permet  de  deteCter  les  pannes  de  fagon  analytique.  Une  autre  composante 
importante  du  systeme  FDIR  est  le  module  d’isolation  de  la  faute  ou  de  la  panne.  II  y  a 
deux  approches  pour  la  conception  et  1  ’  implantation  de  procedures  de  recouvrement.  Une 
propose  d’inclure  tous  les  modes  de  fautes  et  de  pannes  possibles  dans  le  design.  L’autre 
propose  de  generer  en  ligne  une  procedure  de  recouvrement  une  fois  la  panne  detectee. 
Dans  ce  rapport,  nous  allons  examiner  les  avantages  et  les  inconvenients  des  approches 
ci-haut  mentionnees. 
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Chapter  1 
Introduction 


Unmanned  Aerial  Vehicles  (UAV s)  are  indeed  among  the  most  complicated  systems  that  are 
being  developed.  Since  the  motion  of  UAVs  is  specified  in  a  three  dimensional  space  and  they 
operate  in  an  environment  subjected  to  a  high  degree  of  uncertainties  and  disturbances,  the 
problem  of  precise  and  accurate  control  of  such  vehicles  is  difficult  and  requires  complicated 
control  systems  theory.  The  importance  of  utilizing  UAVs  in  a  wide  variety  of  civilian  and 
military  missions  has  been  recognized  by  many  funding  and  research  agencies,  as  well  as  by 
a  large  number  of  companies  in  the  private  sector.  On  the  other  hand,  with  an  increasing 
requirement  for  UAV  control  systems  to  be  more  secure  and  reliable,  fault  tolerance  in  such 
control  systems  is  becoming  more  and  more  critical  and  important. 

In  the  presence  of  undesirable  effects  such  as  failures  in  the  actuators,  control  surfaces, 
or  sensors,  the  UAV  control  systems  must  be  responsive  and  adaptive  to  such  failures.  Un¬ 
der  these  circumstances  there  may  be  a  necessity  to  adjust  the  control  laws  to  recover  the 
UAV  from  the  effects  of  anomalies  and  failures.  Furthermore,  the  required  adjustments  of 
control  laws  must  be  done  expeditiously  in  a  relatively  short  period  of  time  to  guarantee  the 
operation  of  the  safety  critical  subsystems  of  the  UAV.  Specifically,  it  is  required  to  develop 
an  autonomous  fault  diagnosis  and  reconfigurable  control  systems. 

In  particular  for  multiple  UAVs  operating  within  a  given  formation,  if  any  of  the  vehicles 
undergoes  a  failure  and  the  UAV  controller  is  not  equipped  with  autonomous  fault  tolerant 
capabilities,  the  stability  and  formation  of  the  UAVs  may  not  be  maintainable  and  could  lead 
to  instability.  Moreover,  in  leader-follower  formation  flight  schemes,  the  failure  of  the  leader 
UAV,  in  which  the  formation  controller  resides,  may  result  in  the  total  loss  of  performance 
for  all  the  other  follower  UAVs.  Therefore,  the  fault  tolerant  control  systems  for  multiple 
UAVs  environment  needs  to  be  fully  investigated. 

Advanced  computers  have  resulted  in  more  capable  and  advanced  UAV  flight  systems. 
Thus,  activities  like  navigation  and  maneuver  planning,  command  planning  and  sequencing, 
and  fault  diagnosis  and  recovery  can  all  potentially  be  autonomously  handled  onboard  the 
UAV.  Aside  from  the  obvious  cost  savings  realized  by  smaller  operations  staff,  there  are 
traditional  advantages  to  placing  some  of  these  functions  on  the  UAV.  For  example,  onboard 
fault  diagnosis  and  recovery  algorithms  can  detect,  identify,  and  remedy  UAV  faults,  both 
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minor  and  major,  in  real-time ,  possibly  saving  the  mission  in  the  process.  Moreover,  the 
ability  to  plan  UAV  activities  onboard  allows  the  UAV  to  respond  to  major  instrument  fail¬ 
ures  or  other  anomalies  without  impacting  the  remaining  healthy  UAV  subsystems.  In  the 
event  of  a  major  anomaly,  the  UAV  can  respond  quickly  and  generate  a  new  sequence  of 
commands  to  carry  out  the  remaining  possible  mission  objectives.  For  example,  after  the 
occurrence  of  a  fault  in  the  leader  UAV  instruments,  it  can  go  to  the  safe  mode  of  operation, 
if  full  recovery  is  not  feasible,  and  the  leader  responsibilities  will  be  allocated  to  some  other 
UAV  in  the  formation. 

Conventionally,  fault  diagnosis  in  fault  tolerant  control  systems  are  achieved  and  ensured 
through  hardware  redundancy,  that  is,  by  including  redundant  actuators  and  sensors  in  the 
system  (UAV  in  this  project).  The  control  and  measurement  channels  are  generally  made 
duplicated  or  triplicated  in  hardware.  The  main  disadvantage  of  physical  redundancy  is  the 
additional  cost  and  the  corresponding  increase  in  complexity  of  operation.  Moreover,  the 
weight  of  the  UAV  and  the  maintenance  requirements  will  subsequently  increase.  Conse¬ 
quently,  analytical  redundancy  approach,  which  makes  use  of  the  mathematical  model  of  the 
system  and  relationships  between  sensor  output  and  actuator  inputs  (control  signals),  has 
been  proposed  and  are  increasingly  being  employed  in  fault  tolerant  control  systems. 

Building  on  methods  presently  available  in  several  fields  including  estimation  and  obser¬ 
vation  theory,  system  identification,  robust  and  adaptive  control,  intelligent  systems,  and 
system  health  monitoring,  novel  and  innovative  techniques  have  been  proposed  and  fully 
investigated  in  this  project  by  developing  new  capabilities  and  by  relaxing/removing  the 
limitations  of  the  current  state-of-the-art  technology  in  diagnosis,  isolation  and  recovery  as 
they  relate  to  autonomous  aerial  vehicles. 

Our  research  was  mainly  motivated  by  the  fact  that  most  available  fault  detection,  isola¬ 
tion  and  recovery  (FDIR)  techniques  lack  the  capability  to  handle  the  following  two  practical 
issues: 

(i)  Incomplete  and  varying  knowledge  concerning  fault  modes 

(ii)  Existence  of  inevitable  modeling  and  enviromental  uncertainties  such  as  un-modeled 
dynamics,  parameter  uncertainties  and  disturbances. 

To  address  the  above  two  issues,  we  have  integrated  the  analytical  techniques  with  the 
knowledge-based/intelligent  methodologies.  By  taking  advantage  of  the  efficient,  formalized 
and  mathematically  proven  capabilities  of  model-based  approaches,  and  the  capability  of 
knowledge-based/intelligent  systems  in  handling  incomplete,  less  formalized  and  even  uncer¬ 
tain  knowledge,  an  integrated  and  hybrid  framework  is  developed  to  produce  more  flexible 
and  practical  solutions. 

1.1  Objective  of  the  Project 

In  order  to  avoid  adverse  consequences  due  to  failures,  it  is  desirable  to  have  an  advanced 
failure  detection  and  isolation  (FDI)  system  that  detects  and  identifies  anomalies  early  to 
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minimize  the  damage,  and  that  can  remedy  as  many  failures  as  possible.  In  complex  systems, 
fault  diagnosis  id  typically  accomplished  using  a  hierarchical  approach.  In  our  proposed  au¬ 
tonomous  unmanned  vehicle  (UAV)  system,  fault  diagnosis,  isolation  and  recovery  (FDIR) 
is  accomplished  by  using  a  hierarchical  and  decentralized  approach.  At  this  level  of  the 
hierarchy  the  model  based  or  analytical  redundancy  based  approach  to  FDIR  would  require 
a  mathematical  model  of  the  process  or  sub-process  under  consideration.  Based  on  this 
knowledge  quantities  called  residuals  will  be  generated.  The  residuals  should  be  small  or 
close  to  zero  when  there  are  no  failure  in  the  system.  On  the  other  hand,  they  should  become 
nonzero  and  grow  large  if  there  are  malfunctions  in  the  system.  This  will  accomplish  the 
failure  detection.  The  next  important  task  will  be  the  design  of  a  fault  isolation  module  that 
would  isolate  the  faulty  components  or  subsystems. 

There  are  essentially  three  distinct  FDIR  approaches  that  have  been  investigated  in  this 
project: 

•  Techniques  that  use  physically  based  model  of  the  unmanned  vehicles,  and  use  the 
model  based  techniques  from  estimation  and  control  domain  to  tackle  the  problem. 

•  Techniques  that  are  artificial  neural  networks  (ANN)  for  model  development  and  use 
those  models  along  with  other  intelligent  networks  for  fault  detection  and  isolation 
purposes. 

•  Finally,  use  the  combination  of  the  above  two  methodologies  for  both  model  develop¬ 
ment  as  well  as  the  fault  detection,  isolation  and  recovery  logic. 

There  are  two  major  approaches  to  the  design  and  implementation  of  recovery  procedures, 
One  is  to  synthesize  the  procedures  for  every  possible  failure  mode  at  the  design  stage.  One 
the  diagnostic  and  recovery  system  is  activated,  it  monitors  the  system  and  if  it  detects 
a  failure,  then  the  system  will  initiate  the  appropriate  recovery  procedure.  In  the  other 
approach,  suitable  recovery  procedures  are  generated  ”  on-line”  upon  the  detection  of  failures. 
We  will  examine  the  advantages  and  drawbacks  of  the  above  approaches  in  our  framework. 
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Chapter  2 

Issues  of  Cooperative  UAV  Control 


In  a  number  of  future  civilian  and  military  operations  it  is  expected  that  one  needs  to  utilize 
a  large  number  of  unmanned  ground  vehicles  (UGVs),  unmanned  aerial  vehicles  (UAVs), 
and  unattended  ground  sensors  (UGSs)  that  are  configured  to  concurrently  perform  Com¬ 
mand,  Control,  Communication,  Computing,  Intelligence,  Surveillance,  and  Reconnaissance 
(C4ISR)  offering  extended  capabilities.  The  expected  sheer  number  of  unmanned  assets  or 
nodes  (this  is  UGVs,  UAVs,  and  UGSs)  that  are  planned  to  be  used  and  their  correspond¬ 
ing  dynamics,  coupling  interactions,  network  bandwidth  constraints,  data  latency  (delays 
in  data  time  of  arrival),  scheduling  and  real-time  requirements,  data  acquisition,  priorities, 
processing  and  routing  requirements  all  to  be  controlled  and  managed  seamlessly,  would 
introduce  challenging  problems  for  the  operators  and  managers.  These  challenges  call  for 
the  development  of  innovative  and  novel  autonomous,  intelligent  and  distributed  algorithms 
where  a  cluster  of  unmanned  systems  (UMS)  in  collaboration  and  cooperation  with  other 
UMS  clusters  would  autonomously  or  semi-autonomously  achieve  and  contribute  to  accom¬ 
plishing  the  desired  performance  specifications  and  requirements  with  minimal  support  and 
involvement  of  commanders  and  operators. 

Specifically,  typical  military  missions  of  multiple  UAVs  involve  3-D  stereographic  map¬ 
ping,  platforms  for  wide  aperture  sensors,  grouping  and  regrouping  for  purposes  of  attack, 
damage  assessment,  decoys  and  high-G-force  maneuvers.  In  civilian  applications,  UAV  teams 
are  used  in  the  areas  such  as  coastal  and  border  surveillance,  embargo  enforcement,  human¬ 
itarian  and  disaster  assistance,  bridge  inspection,  fire-spotting,  border  patrol,  and  oceano¬ 
graphic  and  meteorological  data  collection  [6] . 

Current  issues  in  cooperative  UAV  control  are  presented  by  topics  [7].  Aerial  surveillance 
and  tracking  allows  vision-based  control.  Collision  and  obstacle  avoidance  and  formation 
reconfiguration  ensure  safe  cooperation  for  groups  of  aircraft.  High  level  control  is  needed 
to  coordinate  large  groups  of  UAVs  and  for  real-time  human  interfacing,  and  all  of  these 
depend  on  system  hardware  and  communications. 


2.1  Aerial  Surveillance  and  Tracking 

Aerial  Surveillance  and  Tracking:  Surveillance,  detection  and  tracking  have  been  studied  and 
developed  in  the  past  for  static  security  cameras,  ground  vehicles  and  manned  aircraft.  The 


15 


main  challenges  of  migration  to  UAVs  are  due  to  the  physical  constraints  of  the  platform 
.and  the  strict  real-time  requirements  the  applications.  It  is  usually  not  feasible  to  carry 
significant  amounts  of  hardware  due  to  size,  weight,  and  power  limitations.  At  the  same 
time  it  is  of  paramount  importance  to  process  the  sensor  input  at  a  real-time  rate:  while 
some  seconds  of  delay  in  the  recognition  of  an  intruder  for  a  security  camera  application  may 
not  be  a  problem,  this  could  result  in  loss  of  the  target  in  a  UAV  application  due  to  the  high 
speed  of  the  aircraft  [7] . 

2.2  Path  Planning 

Path  planning  is  one  of  major  issues  that  need  to  be  addressed  in  the  development  of  multiple 
UAVs  control.  A  path  planning  algorithm  computes  a  trajectory  from  the  UAV’s  present 
location  to  a  desired  future  location,  e.g.  a  target  [8]. 

A  good  path  planning  algorithm  for  UAVs  must  possess  several  important  attributes, 
making  its  design  a  multiple-objective  optimization  problem  [8].  First  it  must  compute 
a  stealthy  path,  steering  the  aircraft  and  its  radar  signature  around  known  enemy  radar 
locations.  This  is  difficult  because  no  aircraft  scatters  or  reflects  radar  radiation  uniformly 
in  all  directions.  Rather,  radiation  is  radiated  more  strongly  in  some  direction,  and  less 
strongly  in  others.  Second,  generated  trajectories  should  be  of  minimal  length,  subject 
to  the  stealthy  constraint,  and  also  satisfy  the  aircraft’s  dynamic  constraints.  Third,  the 
path-planning  algorithm  must  be  compatible  with  the  cooperative  nature  envisioned  for  the 
UAV.  A  typical  mission  might  involve  multiple  UAVs  attacking  single,  well-defended  target. 
The  path  planner  would  be  a  component  -  a  subroutine  -  of  the  hybrid  control  system  that 
ensures  all  UAVs  arrive  simultaneously.  And  finally,  path  planner  algorithms  are  expected  to 
be  coded  in  software  that  runs  on  an  airborne  processor.  Thus,  they  must  be  computationally 
efficient  and  “real-time”,  enabling  the  UAV  to  re-plan  its  trajectory  should  an  unforeseen 
threat  arise. 

Towards  these  objectives,  a  number  of  studies  have  conducted  [9,  10,  11,  12,  13,  14].  For 
example,  Jun  and  D’Andrea  [15]  proposed  a  path  method  for  UAVs  by  using  a  probability 
map.  The  approach  in  this  paper  is  similar  to  those  in  [8]  and  [16]  in  which  one  decomposes 
the  problem  into  two  steps:  first  the  generation  of  a  preliminary  polygonal  path  by  using  a 
graph,  and  then  a  refinement  of  the  path.  In  [15] ,  the  nodes  and  links  of  the  graph  are  based 
directly  on  the  probability  map.  The  authors  also  consider  the  effects  of  moving  threats, 
changes  in  the  probability  map,  and  multiple  vehicles,  and  perform  an  analysis  of  the  effects 
of  refinement  on  the  initial  path. 


2.3  Collision  and  Obstacle  Avoidance 

Collision  and  obstacle  avoidance  are  the  basis  of  safe  UAV  flight.  Here,  collision  avoidance 
refers  to  non-collision  among  cooperative  UAVs,  and  requires  that  aircraft  either  detect  each 
other  using  sensors  or  report  their  positions  [7].  Collision  avoidance  is  usually  incorporated 
into  a  cooperative  flight  algorithm.  Obstacle  avoidance  is  distinguished  by  lack  of  knowledge 
and  cooperation:  an  obstacle  may  take  any  form  and  may  be  either  inert  or  hostile  (including 
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seeking  a  collision),  hence  detection  is  a  primary  problem.  The  ability  to  see  and  avoid 
obstacles  is  a  necessary  condition  for  flight  in  civil  airspace,  and  for  low  altitude  applications 
■  such  as  urban  canyon  navigation.  Once  an  obstacle  has  been  detected,  the  flight  path  must 
be  altered  in  order  to  ensure  aircraft  safety  while  minimizing  deviation  from  the  optimal 
path  and  continuing  to  ensure  collision  avoidance  [7] . 

2.4  Cooperative  Control 

2.4.1  Cooperative  Control  Law 

In  order  to  achieve  the  cooperative  control  of  multiple  UAVs,  the  high  level  cooperative 
control  law  has  to  be  applied  to  the  UAV  team.  As  discussed  previously,  typical  missions 
of  multiple  UAVs  include  3-D  stereographic  mapping,  platforms  for  wide  aperture  sensors, 
coastal  and  border  surveillance,  etc.  Towards  these  ends,  different  cooperative  control  laws 
need  to  be  developed.  For  example,  some  of  missions  require  the  UAVs  flying  in  formation, 
in  which  the  dynamics  of  the  UAVs  is  tightly  coupled  either  by  control  laws  governing  the 
formation  behavior  or  by  a  combination  of  aerodynamics  formation  control  law  [17]. 

Leader-Follower  approach  is  a  typical  formation  flight  control  law,  in  which  the  fol¬ 
lower  UAV  follows  the  trajectory  of  the  leader,  taking  the  other  aircraft  as  reference  to 
keep  its  own  position  inside  the  formation  [18].  To  compute  the  distance  to  its  reference, 
each  aircraft  acquires  its  position  P  =  ( X ,  Y ,  H)  from  a  GPS-based  position  sensing  sys¬ 
tem  and  receives,  through  appropriate  communication  channels,  the  other  aircraft’s  posi¬ 
tions  Pr  =  (XR,  Yr,  Hr).  The  formation  control  is  also  responsible  for  having  each  aircraft 
follow  a  prescribed  path.  The  formation  control  receives  path  information  in  terms  of  ve¬ 
locity,  heading,  and  altitude  Tr  =  (Vr,  Hr,  Tr).  Then  the  received  data  vector  becomes 
Rr  =  (Xr,  Yr,  Hr,  Vr,  ^r).  The  commanded  trajectory  for  the  “inner-loop”  control  is 
Tc  —  Tr  +  AT . 

In  addition,  there  are  two  types  of  scenarios  can  be  implemented: 

•  Leader  Mode:  Both  followerl  and  follower2  take  the  trajectory  references  from  the 
Leader  of  the  formation. 

•  Front  Mode:  Each  aircraft  takes  its  reference  from  the  preceding  one.  In  this  case, 
followerl  is  referred  to  the  leader  and  follower 2  is  referred  to  followerl. 

In  addition,  reference  [19,  20,  21]  considers  the  control  of  interacting  subsystems  whose 
dynamics  and  constraints  are  uncoupled,  but  whose  state  vectors  are  coupled  non-sepaxably 
in  a  single  centralized  cost  function  of  a  finite  horizon  optimal  control  problem.  For  a  given 
centralized  cost  structure,  the  authors  generate  distributed  optimal  control  problems  for  each 
subsystem  and  establish  that  the  distributed  receding  horizon  implementation  is  asymptoti¬ 
cally  stabilizing.  The  communication  requirements  between  subsystems  with  coupling  in  the 
cost  function  are  that  each  subsystem  obtains  in  the  previous  optimal  control  trajectory  of 
those  subsystems  at  each  receding  horizon  update. 

Furthermore,  Olfati-Saber  and  Murray  [22]  provided  a  unified  graph-theoretical  frame¬ 
work  that  allows  ones  to  formally  define  formations  of  multiple  vehicles  and  their  stabilization 
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issues.  They  clarified  the  important  role  of  graph  rigidity  and  minimally  rigid  graphs  in  con¬ 
struction  of  structural  potential  functions  and  manipulation  of  multiple  formations.  This 
,  includes  -formal  representation  of  split,  rejoin,  and  reconfiguration  maneuvers  for  formations 
of  multi- vehicle  systems. 

Other  than  formation  flight,  some  of  the  missions  require  the  control  of  spatially  dis¬ 
tributed  UAV  systems  that  are  not  coupled  dynamically  by  aerodynamic  forces  or  low-level 
control  law.  For  example,  in  certain  scenarios,  the  objectives  are  for  the  UAVs  to  arrive  at 
.their  targets  simultaneously  (UAV  rendezvous)  with  sufficient  fuel  to  return  to  base  while 
minimizing  the  risk  of  detection  by  threats  [17].  From  a  strategic  standpoint,  simultaneous 
arrival' at  the  targets  increases  the  element  of  surprise  and  decrease  the  risk  of  detection. 
Once  the  targets  have  been  hit,  the  cooperative  control  must  plan  the  egress  of  the  UAVs. 

.  Mclain  et  al.  [17]  proposed  a  cooperative  control  law  to  approach  the  cooperative  control 
UAV  rendezvous.  In  their  work,  firstly,  the  path  planner  for  each  UAV  must  produce  a 
family  bf.paths  from  its  initial  location  to  its  target.  The  cost  for  each  path  in  the  family  of 
paths  is  based  on  the  proximity  of  the  each  path  to  the  threats.  Moreover,  a  decomposition 
solution  is  developed  in  order  to  not  only  find  the  best  solution  for  the  team  as  a  whole,  but 
also  compute  the  team  optimal  solutioris  in  a  decentralized  manner. 

Another  kind  of  cooperative  UAV  control  involves  a  large  number  of  UAVs  that  can  be 
considered  as  a  flock.  Flocking  behavior  is  based  on  prioritized  interactions  between  three 
agent  types.  When  a  flock  member  (ct)  detects  an  obstacle,  it  creates  virtual  (3  and  7  agents, 
and  its  behavior  is  then  determined  by  the  location  of  all  agents,  prioritized  to  ensure  obstacle 
avoidance,  [5] . 

Interactions  between  a  agents  are  represented  using  a  structural  net  and  can  be  char¬ 
acterized  as  attempting  to  keep  a  specified  neighbor  separation.  The  control  law  is  based 
on  the  structural  energy  of  the  flock.  A  development  of  interest  is  the  representation  of 
Reynolds’  three  boid  protocol  using  a  single  protocol  for  a  —  a  interaction  [7]. 

2.4.2  Cooperative  Reconfigurations 

When  UAVs  perform  a  cooperative  task  by  flying  as  a  group,  they  may  be  considered  flying  in 
a  formation  or  a  flock.  Groups  must  safely  reconfigure  in  response  to  changing  missions,  UAV 
populations,  environments,  and  UAV  faults.  The  approaches  of  formation  reconfiguration 
are  related  to  the  high  level  control  very  much. 

Using  a  hybrid  systems  approach,  a  specific  formation  can  be  seen  as  a  finite  state 
machine,  where  transitions  between  different  formation  (or  state  machines)  can  be  triggered 
by  changes  in  mission  or  environment.  The  transition  processing  must  reassign  aircraft  to 
positions  in  the  new  formation  and  provide  trajectories  from  the  initial  formation  positions 
to  the  new  ones. 

In  addition,  for  a  loosely  defined  cooperative  UAV  control  such  as  a  flock,  reconfiguration 
may  be  inherent  in  the  formation  flight  algorithm.  Specifically,  the  framework  proposed  in 
reference  [22,  23] enables  ones  to  address  split/rejoin  and  squeezing  maneuvers  for  nets/flocks 
of  dynamic  agents  that  communicate  with  each  other. 
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2.5  Cooperative  Control  Management  (Supervisor) 

In  order  to  achieve  the  high  level  cooperative  control,  management  of  the  aircraft  team 
has  to  be  addressed.  Management  of  the  aircraft  team  can  be  centralized  or  decentralized 
[18].  In  the  former  case,  one  team  manger  acts  as  a  supervisor  for  all  the  aircraft  and 
manages  the  topology  of  the  channels  used  to  exchange  information  among  them.  In  a 
decentralized  management  scheme,  one  the  other  hand,  each  aircraft  is  given  a  certain  level 
of  decision  capability,  while  the  whole  formation  must  be  capable  of  reconfiguring,  making 
decisions,  and  achieving  mission  goals.  The  problem  with  distributed  management  is  that: 
the  distributed  decision-making  algorithm  must  produce  deterministic  results  on  all  the 
managed  components;  that  is,  on  all  the  aircraft,  conflicting  decisions  must  be  avoided  for 
formation  safety.  The  advantages  of  distributing  the  management  are  several: 

•  Only  inter-aircraft  information  must  be  exchanged. 

•  The  same  data  channels  used  by  formation-keeping  control  could  be  used  to  exchange 
management  information. 

•  Very  low  power  or,  alternatively,  non-radio-based  communications  such  as  optical  sen¬ 
sors  can  be  used  because  of  the  very  small  distances  among  aircraft.  This  could  be  very 
important  for  military  applications,  (as  opposed  to  aircraft-ground  communications). 

•  ,  Reaction  times  can  be  minimized,  (as  opposed  to  aircraft-ground  communications). 

2.6  Hardware  and  Communications 

Sensor  choices  are  intimately  tied  to  the  platform  and  constraints  on  payload  size,  weight, 
and  power.  Vision  systems  utilizing  conventional  and/or  infrared  cameras  are  commonly 
used  for  mapping  and  obstacle  detection/avoidance  applications.  One  of  the  major  issues 
for  collaborative  unmanned  aircraft  is  wireless  communication  with  other  cooperating  air¬ 
craft  and/or  the  ground.  Aircraft-to-aircraft  communication  is  a  more  recent  problem  with 
the  increasing  availability  of  wireless  LAN  and  GSM  technologies.  High-bandwidth  commu¬ 
nications  may  be  needed.  Aircraft-to-aircraft  communications  may  also  be  required  in  out 
of  line-of-sight  conditions  due  to  distance  or  obstacles. 

More  importantly,  the  communications  graph  should  be  redundant  from  the  standpoint 
of  the  capability  of  propagating  information.  In  the  event  of  faults,  this  redundancy  leaves 
room  for  reconfiguration. 

Optimization  of  Communication  Channels 
To  use  an  optimization  technique,  each  arc  must  be  given  a  weight.  The  cost  function  will 
minimize  the  total  cost  of  the  information  paths  throughout  the  formation  using  the  arcs’ 
weights  to  evaluate  the  cost  of  a  connection. 

Redundant  Channels 

Once  an  optimal  non-redundant  set  of  arcs  has  been  found,  lower  priority  suboptimal  re¬ 
dundant  arcs  could  be  added  to  the  active  channels  for  two  reasons:  for  mixing  sensor 
information  for  control  and  as  alternatives  in  emergency  and  fault  conditions. 
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Graph  Theory  Approach  to  Optimization 

Under  certain  assumptions  proposed  by  [18],  the  optimization  problem  can  be  configured  as 
a  shortest  path  problem  using  Dijkstra  algorithm  [24]. 

2.7  Fault  Detection,  Isolation  and  Recovery  (FDIR) 
for  UAVs  and  Potential  Research  Areas  of  this 
Project 

Along  these  lines,  UAVs  are  indeed  among  the  most  complicated  systems  that  are  being  de¬ 
veloped.  Since  the  motion  of  an  aircraft  is  specified  in  a  three-dimensional  space  and  aircraft 
operate  in  ah  environment  subjected  to  a  high  degree  of  uncertainties  and  disturbances,  the 
problem  bf  precise  and  accurate  control  of  such  vehicles  is  difficult  and  requires  complicated 
control  system  theory.  With  an  increasing  requirement  for  aircraft  flight  control  systems  to 
be  more  secure  and  more  reliable,  fault  tolerance  in  such  control  systems  is  becoming  more 
and  more  critical  and  important. 

In  the  presence  of  undesirable  effects  such  as  faults  in  the  actuators,  control  surfaces,  or 
sensors, -the  aircraft  flight  control  systems  must  be  responsive  and  adaptive  to  such  faults. 
Under  these  circumstances  there  may  be  a  necessary  to  adjust  and  fine-tune  the  control  laws 
v  to  recover  the  aircraft  from  the  effects  of  anomalies  and  faults.  Furthermore,  the  required 
adjustments  of  control  laws  must  be  done  expeditiously  in  a  relatively  short  period  of  time 
to' guarantee  the  operation  of  the  safely  critical  subsystems  of  the  aircraft.  Specifically,  what 
is  required  is  to  develop  an  autonomous  fault  diagnosis  and  reconfigurable  flight  control 
■  systems. 

Based  on  the  recognized  issues  in  cooperative  UAV  control,  Figure  2.1  depicts  the  research 
areas  we  will  investigate  in  this  project.  Due  to  limited  time  and  resources,  we  are  not  going 
to  investigate  areas  like  Mission  Planning,  Path  Planning,  Collision  Avoidance,  and  Obstacle 
Avoidance. 

2.8  UAVs’  Cooperative  Tasks 

A  cooperative  system  is  loosely  defined  as  a  collection  of  dynamical  entities  that  share 
information  to  accomplish  a  common,  though  perhaps  not  singular,  objective  [25].  In  order 
to  refine  the  above  definition,  one  has  to  define  some  fairly  specific  goals  for  cooperating 
UAVs.  However,  in  order  to  define  these  goals,  some  assumptions  should  be  devised.  A 
fundamental  assumptions  is  that  the  UAVs  will  be  multi-role,  that  is,  they  each  have  multiple 
functions  or  capabilities  such  as  searching  for  targets,  destroying  targets,  reporting  on  target 
damage,  various  surveillance  roles,  a  communication  relay  role,  egress  and  landing.  Also, 
good  measures  of  effectiveness  (MOEs)  for  a  team  of  UAVs  are  often  task  oriented  and  likely 
multi  criteria  in  nature.  A  task-based  viewpoint  portrays  the  UAVs  as  a  constrained  resource 
with  multiple  conflicting  demands.  Meanwhile,  the  UAVs  are  expected  to  do  well  on  non 
task-based  performance  measures,  such  as  increased  flight  time  through  the  use  of  efficient 
trajectories  and  collision  avoidance. 
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Figure  2.1:  Potential  Research  Areas  of  this  Project 


, . .  In  summary,  cooperative  systems  are  multi-role  and  simultaneously  task-based,  and 
performance-based.  Task-based  measures  tend  to  evolve  discretely,  for  instance,  switch¬ 
ing  through  modes  of  operation  or  multiple  dynamic  models.  So  for  modeling  cooperative 
systems,  we  require  hybrid  dynamics  model  with  the  discrete  dynamics  associated  with  all 
the  task-based  cooperative  control  functions  while  the  continuous  dynamics  are  associated 
with  the  performance-based  and  autonomous  control  functions.  In  such  architecture,  the 
operating  mode  and  waypoints  from  the  discrete  controller  are  inputs  to  the  continuous  con¬ 
troller  while  the  local  measurements  and  measurements  transmitted  from  other  UAVs  are 
inputs  to  the  discrete  controller.  It  should  be  noted  that  the  discrete  dynamics  are  much 
slower  than  the  continuous  ones. 

Effective  cooperation  often  requires  that  individual  UAVs  coordinate  their  actions  [26] . 
Coordination  can  take  many  forms  ranging  from  “staying  out  of  each  others  way”  to  directly 
assisting  another  UAV.  Basically,  there  exist  two  sorts  of  coordination  among  UAVs:  (1) 
global  coordination,  in  which  a  UAV  coordinates  its  action  with  every  other  UAV  in  the 
team,  and  (2)  local  coordination,  which  is  in  contrast  to  the  global  one.  However,  due  to 
communication  constraints  and  computational  feasibility,  researchers  are  primarily  interested 
in  group  coordination  problems  where  the  coordination  takes  place  locally.  Thus,  one  of  the 
challenges  in  UAV  cooperative  control  would  be  the  design  of  local  coordination  strategies 
that  will  result  in  group  cooperation.  However,  as  was  mentioned  above  we  need  to  specify  the 
cooperative  task  and  its  associated  objective  in  order  to  have  a  good  measure  of  effectiveness 
for  assessing  the  performance  of  the  applied  coordination  algorithm.  In  the  subsequent 
sections  we  will  briefly  describe  the  existing  cooperative  tasks  and  missions  together  with 
their  associated  objectives  reported  in  the  literature. 
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2.8.1  Aerial  Surveillance 

There  are  numerous  applications  requiring  aerial  surveillance  [26]. 

•  Civilian  Applications:  monitoring  forest  fires,  oil  fields,  and  tracking  wildlife. 

•  Homeland  Security:  border  patrol  and  monitoring  the  perimeter  of  nuclear  power 
plants 

•  Military  Applications 

Beard  et  al.  [26]  have  proposed  a  cooperative  control  strategy  for  aerial  surveillance  that  has 
been  successfully  flight  tested  on  small  UAVs.  Their  approach  can  be  summarized  in  four 
steps: 

(i)  Cooperation  Objectives  and  Constraints:  the  definition  of  a  cooperation  con¬ 
straint  and  cooperation  objective.  Certain  relationships  between  state  variables  of  the 
UAVs  are  called  cooperation  constraints. 

(ii)  Coordination  Variable  and  Coordination  Function:  the  definition  of  a  coordi¬ 
nation  variable  as  the  minimal  amount  of  information  needed  to  satisfy  the  cooperation 

■  objective.  Also,  the  relationship  between  the  coordination  variable  and  the  cooperation 
objective  known  as  the  coordination  function  must  be  specified. 

•(iii)  Centralized  Cooperation  Scheme:  the  design  of  a  centralized  cooperation  strategy 
to  minimize  the  team  objective  function  assuming  that  each  UAV  has  global  knowledge 
of  the  coordination  variable  and  the  coordination  functions  of  other  UAVs  in  the  team. 

(iv)  Consensus  Building:  the  use  of  consensus  schemes  to  transform  the  centralized 
strategy  into  a  decentralized  algorithm  due  to  the  noisy  and  non-persistent  commu¬ 
nication  links  and  dynamically  changing  communication  topology.  Such  an  algorithm 
assures  that  each  UAV  in  the  team  has  consistent  coordination  information  despite  the 
inadequacies  of  the  communication  network. 

As  an  example  of  aerial  surveillance,  Beard  et  al.  [27]  have  investigated  the  cooperative 
forest  fire  surveillance  problem  extensively.  In  this  problem,  multiple  UAVs  are  distributed 
around  the  perimeter  of  a  growing  forest  fire.  The  main  features  of  the  proposed  decentralized 
multiple-UAV  approach  include  (1)  the  ability  to  monitor  a  changing  fire  perimeter,  (2)  the 
ability  to  systematically  add  and  remove  UAVs  from  the  team  (important  for  re-fueling), 
and  (3)  the  ability  to  communicate  time-critical  information  regarding  the  coordinates  of  the 
fire  perimeter  to  fire  fighters  on  the  ground.  However,  it  is  assumed  that  the  UAVs  have  a 
limited  communication  range  that  requires  them  to  work  cooperatively  to  relay  fire  perimeter 
information  to  the  base  station.  In  the  proposed  scenario,  each  UAV  patrols  a  segment  of  the 
periphery  and  whenever  it  encounters  another  UAV,  it  exchanges  information  and  reverses 
direction  until  it  encounters  another  UAV  or  arrives  at  a  predetermined  rendezvous  point. 
As  mentioned  above,  it  is  also  assumed  that  each  UAV  has  limited  fuel,  which  implies  that 
it  must  periodically  return  to  the  base  station  for  refueling. 
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2.8.2  Cooperative  Attack 

The  goals  of  cooperative  attack  include  enhancing  UAV  performance  and  increasing  battle¬ 
field  situational  awareness.  By  sharing  information  on  their  own  states  and  the  state  of  their 
observation,  UAVs  may  re-plan  trajectories  in-flight,  determine  what  targets  to  attack,  and 
increase  the  probability  of  target  detection  and  classification  [28]. 

2.8.3  Close  Formation  Flight 

Early  studies  reported  in  [29]  reported  significant  potential  fuel  savings  that  could  be  gained 
by  close  formation  flight.  Standard  inner/outer  loop  designs  are  extended  to  close-formation 
flight  in  [30].  A  behavioral  approach  to  aircraft  formation  flight  is  given  in  [31],  The  effects  of 
communication  constraints  on  close  formation  flight  are  studied  in  [18].  Rigorous  conditions 
for  stable  formation  flight  with  limited  communication  are  developed  in  [32]. 

2.8.4  UAV  Rendezvous  Problem 

Cooperative  timing  tasks  for  UAVs  are  of  interest  in  many  military  missions.  This  problem 
is  also  known  in  the  literature  as  UAV  rendezvous  problem  [17]  or  target  assignment  and 
intercept  for  UAVs  [33].  In  the  cooperative  timing  problem  proposed  in  [33],  the  cooperation 
objective  is  defined  as  the  simultaneous  (or  with  a  specified  time  spacing)  arrival  of  UAVs 
at  their  targets  (pre-assigned  or  dynamically  assigned),  while  avoiding  threats  (known  a 
priori  or  pop-up)  and  terrain-based  obstacles  (known  a  priori).  The  cooperation  objective 
is  achieved  if  the  arrival  time  constraint  is  satisfied  and  the  quality  of  the  cooperation  is 
measured  by  the  extent  to  which  threats  and  obstacles  are  avoided.  From  strategic  point 
of  view,  simultaneous  arrival  at  targets  increases  the  element  of  surprise  and  decreases  the 
risk  of  detection.  In  [17]  the  authors  define  the  UAV  rendezvous  problem  similarly  with  the 
extra  constraint  that  the  UAVs  should  eventually  have  sufficient  fuel  to  return  to  base.  In 
other  words,  once  the  targets  have  been  hit,  the  cooperative  control  must  plan  the  egress  of 
the  UAVs.  In  [33]  the  authors  define  the  cooperative  timing  problem  as  a  coordinated  target 
assignment  and  intercept  problem.  It  is  defined  as  a  scenario  in  which  we  have  a  group  of 
MUAVs  that  are  required  to  transition  through  N  known  target  locations  (static  targets). 
However,  in  the  region  of  interest  there  are  a  number  of  known  and  pop-up  threats  and  it 
is  desirable  to  have  multiple  UAVs  arrive  on  the  boundary  of  each  target’s  radar  detection 
region  simultaneously.  As  an  approach  towards  the  solution  of  the  problem,  the  authors 
have  decomposed  the  scenario  into  several  sub-problems  given  below: 

•  Assigning  each  UAV  to  a  target  such  that  each  target  has,  if  possible,  multiple  UAVs 
assigned  to  it  with  the  preference  of  high-priority  targets  taken  into  account. 

•  For  each  team  of  UAVs  assigned  to  a  single  target,  an  estimated  time  over  target 
(TOT)  should  be  determined  that  ensures  simultaneous  intercept  and  that  is  feasible 
for  each  UAV  on  the  team. 

•  Determining  a  path  (specified  via  waypoints)  for  each  UAV  such  that  it  could  complete 
the  path  in  the  specified  TOT,  given  its  velocity  constraints. 


•  Transforming  each  waypoint  path  into  a  feasible  trajectory  in  terms  of  turning  rate 
and  velocity  constraints. 

•  Developing  globally  asymptotically  stable  controllers  such  that  the  UAVs  track  their 
specified  trajectory. 

The  authors  in  [16]  have  addressed  the  problem  of  path  planning  and  coordination  of 
multiple  UAVs  in  a  coordinated  UAV  intercept  or  rendezvous  problem.  They  define  the  co¬ 
operation  objective  as  to  jointly  reach  a  target  area  while  minimizing  the  combined  flight’s 
exposure  to  radar.  The  proposed  approach  is  hierarchical  in  the  sense  that  it  consists  of 
two  levels.  At  the  lower  level  is  the  path  planning  module  which  itself  consists  of  a  two 
step  procedure.  First,  an  approximation  to  the  optimal  path  is  made.  Second,  the  initial 
path  is  refined  to  a  flyable  path  by  incorporating  velocity  and  curving  rate  constraints.  At 
the  higher  level,  the  coordination  of  the  timing  of  the  UAVs’  arrival  at  the  target  area  is 
performed  by  the  coordination  agent  or  rendezvous  manager.  In  other  words,  the  rendezvous 
■manager  calculates  the  Estimated  Time  of  Arrival  (ETA)  as  the  coordination  variable  and 
communicates  it  to  all  the  other  UAVs  in  the  team.  The  UAVs  follow  their  planned  trajec¬ 
tories,  generated  based  on  the  calculated  ETA,  until  an  unplanned  event,  such  as  a  pop-up 
threat  occurs.  Then  the  rendezvous  manager  determines  a  new  ETA,  based  on  the  new 
information,  and  consequently  a  new  trajectory  will  be  generated. 

2.8.5  Cooperative  Target  Search  Problem 

This  problem  is  defined  in  [34]  as  the  autonomous  near-optimal  trajectory  generation  in 
order  for  the  UAVs  to  be  able  to  cooperatively  identify  the  maximum  number  of  targets  in 
an  environment  for  which  some  a  priori  data  about  target  distribution  is  available.  More 
specifically,  the  objective  of  each  UAV  in  the  search  problem  is  to  move  over  the  environment 
such  that,  at  the  end  of  the  search,  the  maximum  number  of  new  targets  has  been  identified. 
The  a  priori  data  about  the  environment  is  assumed  to  be  given  as  information  about  the 
likelihood  of  targets  being  located  in  different  regions  of  the  environment.  They  have  also 
assumed  communication  bandwidth  constraints  in  their  work.  Towards  the  solution  to  the 
cooperative  search  problem,  the  authors  have  proposed  an  algorithm  based  on  a  discrete  time 
stochastic  modeling  of  the  problem,  which  is  then  implemented  with  a  dynamic  programming 
technique. 

The  same  authors  as  in  [34]  have  considered  in  [35]  and  [36]  the  similar  problem  of 
cooperative  UAV  target  search  but  this  time  in  risky  environments.  In  other  words,  they 
have  considered  the  possibility  of  threats  in  the  environment  and  these  threats  are  explicitly 
represented  in  the  model  of  the  environment  and  in  the  planning  algorithm.  More  specifically, 
the  cooperation  objective  is  refined  to  identify  as  many  targets  as  possible  and  minimize  the 
loss  or  damage  of  the  UAVs  during  the  mission. 

2.8.6  Cooperative  Target  Search  and  Response  Problem 

In  the  cooperative  search  problem  the  main  objective  is  the  identification  of  the  targets 
while  in  a  search  and  response  problem,  other  than  target  search  the  UAVs’  are  supposed 
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to  perform  attack  and  damage  assessment  tasks  on  each  target  known  or  discovered  through 
the  search  process.  The  authors  in  [37]  have  addressed  the  cooperative  search  and  destroy 
problem.  In  their  work,  some  target  locations  are  suspected  a  ■priori,  while  the  rest  need 
to  be  detected  gradually  through  search  process.  The  tasks  are  determined  in  real-time  by 
the  actions  of  all  UAV s  and  their  sensory  data,  which  makes  the  task  dynamics  stochastic. 
Thus,  the  tasks  must  be  allocated  to  UAVs  in  real-time  as  they  arise.  While  quick  response 
is  more  important  for  known  targets,  efficient  search  is  necessary  to  discover  hidden  targets. 
The  authors  show  that  there  is  always  a  trade-off  between  search  and  task  response.  As  a 
consequence,  they  propose  a  hybrid  algorithm  which  balances  the  search  and  task  response. 
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Chapter  3 

Definitions  of  UAV  Faults 

3.1  Component  Faults 

In  this  section,  we  will  define  component  faults  in  UAV  systems.  Low  level  faults  are  those 
faults  that  can  locally  affect  each  UAV  in  the  team.  These  faults  can  be  classified  as  follows 
(Figure  3.1): 

(i)  Actuator  Faults 

(ii)  Sensor  Faults 

(iii)  Body  Damage  Faults 

(iv)  Transmitter/Receiver  Faults 


3.1.1  Actuator  Faults 

Common  actuator  faults  in  UAVs  include  [6]: 

(i)  Freezing  or  Lock  in-place  (LIP) 

(ii)  Float 

(iii)  Hard-over  Fault  (HOF) 

(iv)  Loss  of  effectiveness 

In  the  case  of  LIP  faults,  the  actuator  ’’freezes”  at  a  certain  condition  and  does  not 
respond  to  subsequent  commands.  HOF  is  characterized  by  the  actuator  moving  to  the 
upper  or  lower  position  limit  regardless  of  the  command.  The  speed  of  response  is  limited 
by  the  actuator  rate  limit.  Float  fault  occurs  when  the  actuator  “floats”  with  zero  moment 
and  does  not  contribute  to  the  control  authority.  Loss  of  effectiveness  is  characterized  by 
lowering  the  actuator  gain  with  respect  to  its  nominal  value.  Different  types  of  actuator 
faults  can  be  parameterized  as  follows: 
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TX/RX  Faults 


Body  Damage 


TX/RX 


Actuator  Faults 


Sensor  Faults 


Figure  3.1:  Low  level  faults  in  UAVs 


(No  Failure  Case) 

0  <  £i  <  ki(t)  <  1,  Vf  >  tp  (Loss  of  Effectiveness) 

Vt  >  tp  (Float)  (3.1) 

Vt  >  tp  (Lock-in-Place) 

Vt>tp  (Hard-over) 

where  tp  denotes  the  time  instant  of  fault  of  the  actuator  ,  ki  denotes  its  effectiveness 
coefficient  such  that  ki  e  [eu  1]  and  £;  denotes  its  minimum  effectiveness. 

The  following  model 

Ui  =  (TikiUd  +  (1  -  (Xi)ui  (3.2) 

includes  all  above  cases,  where  Ujis  the  actuator  output,  ucffs  the  output  of  the  controller 
(which  at  the  same  time,  an  input  to  the  actuator),  =  1  and  ki  =  1  in  no  fault  case, 
<Ji  =  \  and  0  <  /q  <  1  in  the  case  of  loss  of  effectiveness  fault  and  <7;  =  0  in  other  types  of 
fault  where  u%  is  a  position  at  which  the  actuator  locks  in  the  case  of  float,  lock-in- place  and 
hard-over  fault. 

It  is  seen  that  the  unknown  parameters  in  the  above  model  is  the  unknown  actuator  gain 
fcjin  the  case  of  loss  of  effectiveness,  and  the  unknown  position  ut  at  which  actuator  locks  in 
the  case  of  float,  lock- in- place  and  hard-over  faults. 


27 


Figure  3.2:  Actuator  Faults  [1] 

3.1.2  Sensors  Faults 

Common  sensor  faults  include  [38]: 

(i)  Bias 

(ii)  Drift 

(iii)  Performance  degradation  (Loss  of  accuracy) 

(iv)  Freezing 

Figure  3.3  shows  the  effect  of  above  faults  on  the  output  of  the  sensor.  Different  type  of 
sensor  faults  can  be  parameterized  as  follows: 

xi(t)  Vt  >  ta  No  Failure  case 

xi(t)  +  bi  bi(t )  =  0,  biitpi)  t ^  0  Bias 

v  {t)  =  <  Xi ^  +  <  Q  <<  1  Vt>  tFi  Drift 

Xi(t)  +  bi(t)  \bi(t)\  <  bi,bi(t)  e  L°°  Vt  >  tFi  Loss  of  Accuracy 
xi(tFi)  _  Vt  >tFi  Sensor  Freezing 

„  ki(t)xi  0  <  ki  <  ki(t)  <  1  Vt  >t Fi  Calibration  Error 

where  tFi  denotes  the  time  instant  of  fault  of  the  Ah  sensor,  and  bi  denotes  its  accuracy 
coefficient  such  that  bt  G  [-bi,  bi]  where  bi  >  0.  Also,  it  is  seen  that  kt  e  [ku  1],  where  h>  0 
denotes  some  minimum  sensor  effectiveness. 

We  can  conclude  that  the  following  model  include  all  above  cases,  except  the  case  freezing: 

y  =  Kmx  +  b  (3.4) 

where  Km is  a  positive  definite  diagonal  matrix  whose  elements  are  slowly  varying  within 
[ki,  1]  ,  and  elements  of  vector  6that  slowly  varying  within  [—bi,  bj\. 
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(c)  Loss  of  accuracy 


Trill- 


X{t) 


y(t)  "Sf 

(e)  Calibration  Error 


Figure  3.3:  Sensors  Faults  [1] 

3.1.3  Body  Damage  Faults 

Body  damage  faults  are  those  faults  that  are  due  to  damage  in  the  body  of  UAVs.  Modeling 
of  these  types  of  fault  is  very  difficult  and  needs  numerous  experiments.  In  this  section  we 
consider  two  body  damage  faults 

•  Wing  Damage 

•  Control  Effectors  Damage 

Wing  Damage  Faults 

As  discussed  in  Ref.  [39]  based  on  numerical  modeling  and  numerous  wind-tunnel  experi¬ 
ments,  researchers  from  Boeing  developed  Tailless  Advanced  Fighter  Aircraft  (TAFA)  models 
for  different  damage  conditions,  including  the  case  of  no  damage  and  the  cases  of  increments 
of  certain  percentage  of  wing  damage  up  to  the  100%  damage.  For  percentages  of  the  dam¬ 
age  in  between  the  corresponding  matrix  norms,  a  polynomial  approximation  in  the  terms  of 
the  percentage-of-damage  parameter  p  £  [0, 1]  and  carried  out  interpolation  that  resulted  in 
acceptable  approximation  with  a  fifth-order  matrix  polynomial  in  p.  In  this  approach  they 
consider  a  linearized  model  of  a  TAFA  in  the  presence  of  wing  damage.  The  generalized 
aircraft  model  is  of  the  form 


x(t)  —  An(p)x(t)  +  Br>{p)u(t )  (3.5) 

where  x  £  Rn  and  u  £  Rm  denote,  respectively,  the  state  and  control  input  vectors.  The 
time-varying  nature  of  matrices  Ad  and  Bd  is  caused  by  the  wing  damage,  which  affected 


the  dynamics  of  the  aircraft  in  an  abrupt  fashion.  In  [39]  the  following  form  of  these  matrices 
was  proposed: 

Ao(p(t))  =  Ado  +  ADip(t)  +  Ao2P2(t )  +  Auzp^it)  +  AdaP4^)  +  A£>5p5(f)  /o  fi\ 

BD(p(t))  =  Bdo  +  Boipit)  +  BD2P2(t)  +  BD3p3(t )  +  BDAp4{t)  +  BD5p5{t ) 

'where  p  6  [0, 1]  denotes  the  damage  parameter.  The  above  model  sufficiently  and  accu¬ 
rately  covers  all  cases  from  p  =  0  (no-damage  case)  to  p  —  1(100%  wing  damage). 

Control  Effectors  Damage  Faults 

These  faults  are  caused  by  damage  in  the  control  effectors  of  aircraft  such  as  aileron,  rudder 
and  elevator  surfaces.  These  faults  cause  the  changes  in  the  gain  effectiveness  matrix  and 
generate  state-dependent  disturbance  [6].  These  faults  can  be  modeled  using  the  diagonal 
control  effectors  damage  matrix  D  whose  elements  d*  are  equal  to  one  in  the  no-fault  case 
while  in  the  case  of  control  effectors  damage  assumes  values  over  an  interval  [e,  1],  where 
£  <<  l,and  each  value  of  di  is  proportional  to  the  percentage  of  the  loss  of  surface.  The 
resulting  model  is  of  the  form: 

x  =  f(x)  +  g(x)Du  + £(x)  (3.7) 

where  D  =  [  di  d2  ■  •  •  dm  ] ,  and  £(x)  is  a  nonlinearity  arising  due  to  the  asymmetry 
of  damage  aircraft. 

Transmitter/Receiver  Faults 

The  communication  component  faults  can  be  categorized  into  the  following  cases: 

•  Transmitter  (TX)  fault:  This  may  take  place  due  to  the  electronic  malfunctioning 
of  the  transmitter  device,  power  blackout  in  the  transmitter  unit,  or  the  physical 
destruction  of  the  transmitter  antenna,  for  example,  due  to  an  attack. 

•  Receiver  (RX)  fault:  The  fault  in  the  receiver  may  happen  due  to  the  similar  reasons 
as  mentioned  for  the  transmitter. 

3.2  Information  Flow  Faults 

3.2.1  Issues  of  UAV  Communications  in  Cooperative  UAV  Con¬ 
trol 

With  the  emergence  of  the  new  generation  of  UAVs,  one  of  the  crucial  factors  to  ensure  the 
successful  collaboration  among  multiple  UAVs  in  cooperative  missions  is  the  development  of 
reliable,  high  performance  wireless  communication  links  between  them.  The  UAVs  communi¬ 
cate  relevant  information  and  sensory  data  and  can  autonomously  reconfigure  themselves  in 
response  to  the  shared  information  and  their  own  states  to  achieve  the  mission  at  hand.  For 
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example,  in  the  special  case  of  the  autonomous  formation  flight  application,  in  order  for  the 
formation  controller  to  maintain  the  formation  geometry,  each  aircraft  requires  its  position 
from  a  GPS-based  position  sensing  system  and  receives  through  appropriate  communication 
channels  the  other  aircraft’s  positions  and  velocities.  The  air-to-air  communication  system 
enables  the  sharing  of  sensor  and  map  information  among  UAVs,  while  the  air-to-ground 
communication  system  provides  mission  information  and  payload  data  to  the  ground  station 
for  the  purposes  of  mission  control  and  data  analysis  and  display  respectively  [40].  To  be 
more  precise,  the  UAVs  critically  depend  on  communication  to: 

•  Coordinate  among  themselves  in  a  cooperative  mission, 

•  Obtain  high-level  commands  concerning  their  mission,  tasks,  and  objectives,  and 

•  Report  their  observations  to  human  experts  or  to  data  repositories  in  command  and 
control  centers. 

Thus,  due  to  the  critical  importance  of  the  inter-UAV  communication,  acquiring  a  ba¬ 
sic  knowledge  of  the  existing  wireless  communication  technologies  and  challenges  involved 
in  the  application  of  these  technologies  to  UAV  communications  is  essentially  invaluable. 
This  information  will  also  lead  to  a  profound  understanding  of  communication  mechanisms 
among  UAVs  which  will  consequently  result  in  a  more  comprehensible  characterization  of 
communication  faults  or  anomalies.  Also,  the  knowledge  gained  regarding  the  UAV  commu¬ 
nications  paradigms  can  extensively  be  used  in  the  design  of  an  efficient  FDIR  scheme  for 
the  communication  faults  that  arise  in  UAV  teams. 

Wireless  Communication  Networks 

Wires,  which  enabled  the  Internet  revolution,  have  now,  in  many  cases,  simply  become  a 
barrier  to  proliferation  [2].  When  communication  nodes  are  un-tethered,  essentially  new 
opportunities  arise.  For  example,  when  a  large  set  of  embedded  devices  are  wirelessly  con¬ 
nected,  we  will  have  a  multitude  of  sensors  and  actuators  all  around  us  that  can  intelligently 
communicate  and  cooperate  to  fulfill  a  mission.  The  type  of  wireless  communication  net¬ 
works  that  are  of  interest  in  UAV  communication  and  we  will  describe  here  are  currently 
called  ad  hoc  networks.  Figure  3.4  shows  a  general  ad  hoc  network  with  its  associated  nodes. 
Each  node  is  equipped  with  a  wireless  transmitter /receiver  capable  of  transmitting/receiving 
data  packets  to/from  its  neighbors.  Packets  can  be  relayed  from  node  to  node  until  they 
reach  their  final  destination.  Nodes  may  be  mobile,  changing  their  locations  over  time.  Also, 
they  may  switch  themselves  off  from  time  to  time. 

The  wireless  medium  is  unreliable  since  the  transmissions  are  subject  to  obstacles,  re¬ 
flections,  multi-path  effects,  and  fading.  Furthermore,  transmissions  can  interfere  with  each 
other,  thus  making  packet  reception  at  the  destination  more  unreliable  than  in  wired  me¬ 
dia.  Clearly,  the  overall  objective  of  a  wireless  network  is  the  reliable  and  efficient  transfer 
of  packets  from  their  sources  to  their  destinations.  To  fulfill  this  objective,  nodes  of  the 
network  must  perform  the  following  tasks: 

•  Choose  the  power  levels  at  which  they  broadcast  since  that  influences  the  range, 
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Figure  3.4:  An  ad  hoc  wireless  network  [2] 

•  Broadcast  in  a  timely  fashion  to  avoid  interferences  as  much  as  possible,  and 

•  Cooperate  in  relaying  each  other’s  packets. 

For  the  purpose  of  performance  evaluation  of  a  wireless  network,  two  important  perfor¬ 
mance  measures  are  considered  as  follows: 

(i)  Throughput,  which  is  defined  as  the  rate  at  which  the  bits  are  transferred  from  the 
source  node  to  their  final  destination.  It  is  measured  in  bits  per  second. 

(ii)  Delay,  which  is  defined  as  the  time  difference  from  when  a  bit  is  transmitted  at  its 
source  node  and  eventually  received  correctly  at  its  destination  node. 

For  real-time  interactive  services  like  cooperative  UAV  teams,  timeliness  of  receipt  of 
packets  is  extremely  crucial.  Hence,  delay  is  a  highly  important  performance  measure  in 
UAV  communication.  On  the  other  hand,  throughput  is  of  less  significance  due  to  the  rather 
small  size  of  the  information  and  control  data  that  need  to  be  transferred  among  UAVs. 
There  are  some  other  performance  indices  derived  from  the  above  mentioned  performance 
measures  such  as  the  mean  delay  of  packets,  the  standard  deviation  of  the  delay,  or  even  the 
99  percentile  of  the  delay.  All  the  above  performance  indices  are  revealed  under  the  common 
term  of  ‘Quality  of  Service  (QoS)’. 

The  following  four  problems  arise  and  should  be  addressed  in  the  design  of  any  wireless 
network  [2]: 

•  The  Power  Control  Problem:  A  fundamental  issue  faced  by  a  node  in  a  wireless 
network  on  every  transmission  is  how  to  choose  the  power  level  at  which  it  should 
transmit.  As  a  solution,  this  problem  can  be  considered  as  a  feedback-based  set-point 
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regulation  problem.  More  specifically,  the  receiver  can  provide  a  feedback  signal  to 
the  transmitter,  allowing  it  to  regulate  its  transmitted  power  level  so  that  net  received 
signal-to-interference-plus-noise  ratio  at  the  receiver  is  at  a  desired  level. 

•  The  Medium  Access  Control  Problem:  The  issue  is  that  how  nodes  in  a  wireless 
network  schedule  their  transmissions  in  order  to  have  their  packets  received  intelligibly 
by  their  intended  receivers;  i.e.  without  any  destructive  interference  between  packets 
due  to  packet  collisions.  One  scheme  that  has  been  proposed  towards  the  solution  to 
this  problem  is  embodied  in  the  IEEE  802.11  standard  currently  used  in  Wireless  Local 
Area  Networks  (WLAN)  [29].  This  protocol  employs  reservation  packets  to  reserve  the 
channel  locally  in  space  for  data  packets. 

•  The  Routing  Problem:  Since  in  an  ad  hoc  network,  the  address  of  a  node  is  just 
simply  a  name,  it  does  not  provide  any  information  regarding  the  node  location  or  how 
to  reach  it.  This  gives  rise  to  the  problem  of  how  to  determine  the  route  to  be  followed 
by  packets  from  their  sources  to  their  given  destinations. 

•  The  Traffic  Control  Problem:  Given  the  inherent  shared  nature  of  the  wireless 
medium,  the  question  is  that  what  is  the  ultimate  traffic-carrying  capacity  of  wireless 
networks?  The  answer  will  provide  a  design  objective  to  be  satisfied.  The  performance 
measure  that  will  be  analyzed  for  this  respect  is  the  transport  capacity  of  the  network 
that  is  defined  as  the  aggregate  bit-meters/second  (bit-m/s)  that  the  network  as  a 
whole  can  transport. 

Currently,  the  Wireless  Local  Area  Network  (WLAN)  with  the  standard  off-the-shelf  pro¬ 
tocol  of  IEEE  802.11  is  in  extensive  use  in  developed  societies.  Also  Wireless  Metropolitan 
Area  Network  (WMAN)  with  the  newly  developed  IEEE  802.16  standard  protocol  is  getting 
into  the  US  market.  The  main  difference  between  these  two  networks  is  the  maximum  al¬ 
lowable  distance  between  two  nodes  in  the  network.  While  in  WLAN  the  maximum  distance 
is  almost  100  meters  in  an  obstacle  free  environment,  in  the  case  of  WMAN  this  distance  is 
extended  to  the  order  of  kilometers.  In  terms  of  the  throughput,  some  WLAN  protocols  like 
IEEE  802.  llg  can  provide  up  to  54Mbps  rates. 

Communication  Networks  in  Cooperative  UAVs 

In  a  cooperative  UAV  control,  each  UAV  participates  in  two  networks  [40]: 

•  An  external  wireless  network  that  enables  the  coordination  and  communication  of  the 
UAV  with  other  entities,  such  as  other  UAVs  or  ground  stations,  and 

•  An  internal  network  that  connects  on-board  sensors,  actuators  and  other  devices. 

For  the  internal  network,  any  of  the  existing  commercial  industrial  (wired)  network  types 
such  as  Ethernet,  ControlNet,  or  DeviceNet  can  be  used.  Especially  DeviceNet  with  the  CAN 
(Control  Area  Network)  protocol  is  of  high  interest.  CAN  [41]  is  a  serial  communication 
protocol  developed  mainly  for  applications  in  the  automotive  industry  but  is  also  capable 
of  offering  good  performance  in  other  time-critical  applications  like  UAVs.  However,  the 
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internal  network  of  a  UAV  is  not  the  research  issue  of  interest  in  our  project.  Basically,  as 
was  mentioned  earlier,  we  are  interested  in  inter-UAV  communications  (external  network) 
fault  detection  and  recovery. 

UAV-to-UAV  wireless  communication,  however,  is  a  more  recent  problem  and  is  currently 
implemented  with  proprietary,  application-specific,  and  inflexible  protocols  that  use  point- 
to-point,  fixed-bandwidth  channels.  The  challenge  is  to  enable  UAV  communication  that 
supports  scalable,  evolvable,  and  intelligent  protocols.  To  the  best  of  our  knowledge,  to 
date  there  is  no  field-tested  COTS  (Commercial  Off-the-Shelf)  solution  for  this  application. 

The  difficulties  include  finding  antennas  with  suitable  omni-directional  patterns  and  low 
power  requirements.  Inter-UAV  communication  may  also  be  required  in  out  of  line-of-sight 
conditions  due  to  distance  or  obstacles.  Furthermore,  the  possibility  of  relatively  large 
distances  among  UAVs  and  more  importantly  the  very  high  relative  speed  of  the  UAVs  (the 
mobile  nodes  of  the  communication  network)  make  the  implementation  of  a  reliable  wireless 
communication  scheme  more  challenging.  Some  studies  [42]  have  recently  been  done  on 
performance  evaluation  of  the  application  of  WLAN  (IEEE  802.11a)  and  WMAN  (IEEE 
802.16)  networks,  using  OFDM  (Orthogonal  Frequency  Division  Multiplexing)  based  multi- 
carrier  transmission  technology  [43],  to  UAV  wireless  communication.  However,  as  stated 
therein,  the  wireless  communication  channel  in  UAV  communications  is  largely  different 
from  other  “traditional”  wireless  channels  in  the  fact  that  in  the  later  ones,  one  end  (the 
base  station)  is  fixed  and  the  relative  speed  of  the  other  end  (mobile  terminal)  to  base 
station  is  hardly  over  80  miles  per  hour.  By  Contrast,  in  UAV  communications,  the  relative 
speed  of  the  both  ends  of  the  communication  system  could  be  as  high  as  500  miles  per 
hour.  Such  high  mobility  leads  to  much  shorter  coherence  time  and  a  larger  Doppler  spread 
[43]  in  the  multi-path  fading  channel.  Thus,  the  Inter-Carrier-Interference  (ICI)  is  much 
larger  than  those  of  WLAN  and  WMAN  scenarios.  Nonetheless,  based  on  the  simulation 
results  reported  in  [42],  the  Bit  Error  Rate  (BER)  performance  of  the  OFDM  based  UAV 
communications,  i.e.  at  high  relative  speeds  of  UAVs,  is  still  comparable  to  the  traditional 
OFDM  based  WLAN  networks.  Thus,  the  authors  [42]  conclude  that  with  a  proper  selection 
of  its  parameters,  wireless  OFDM  based  technology  would  be  a  feasible  choice  for  next 
generation  UAV  communications. 

UAV  Cooperative  Control  with  Communication  Constraints 

Even  in  the  presence  of  a  highly  reliable  and  efficient  communication  network  among  UAVs, 
there  are  always  some  information  flow  constraints  such  as  bandwidth  limitations,  delays,  and 
range  and  network  topology  limitations  of  the  inter-UAV  communication.  These  constraints 
and  their  effects  on  the  cooperative  UAV  control  have  been  studied  by  researchers  in  [44], 

[45],  [46], 

In  [44],  the  authors  have  developed  algorithms  for  team-optimal  and  individually-optimal/team- 
suboptimal  solutions  for  multiple  UAV  cooperative  search  problem  subject  to  the  constraints 
of  collision-avoidance  and  that  the  UAVs -should  stay  within  communication  range  of  one 
another.  More  specifically,  the  control  objective  for  the  team  is  to  maximize  the  regions 
of  opportunity  visited  by  the  team,  while  minimizing  the  regions  of  hazard,  subject  to  two 
path  constraints:  (1)  that  the  communication  network  remains  connected  at  all  times,  and 
(2)  that  there  are  no  collisions  between  UAVs. 
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In  [46],  the  author  has  considered  the  UAV  cooperative  control  problem  with  information 
flow  constraints.  Three  different  form  of  communication  constraints  are  modeled  that  repre¬ 
sent  communication  of  information  between  UAVs  as  a  sequence  of  impulses,  a  band-width 
limited  signal,  and  a  range-limited  signal.  Then  the  UAV  cooperative  control  problem  with 
the  above  information  flow  constraints  is  formulated  as  a  series  of  generalized  optimal  control 
problems  by  considering  the  inter- UAV  communication  as  another  control  input.  The  three 
proposed  models  for  the  information  flow  constraints  are  as  follows: 

•  Communication  with  constraints  among  UAVs  as  a  sequence  of  impulses 

Here  the  information  flow  constraints  among  UAVs  is  modeled  as  a  sequence  of  impulses 

v(t)  =  ^  Q<i(t  -  U),  U+i  ~U>T  (3.8) 

i 

where  the  time  interval  between  two  impulses  is  greater  than  some  constant  T.  Then  the 
task  planning  tasks  of  UAV  cooperative  control  is  with  the  above  communication  constraint 
is  formulated  to  be  a  generalized  optimal  control  tasks  with  the  constraint  in  (3.8),  that  is, 

ftf 

min  J  =  4>(x(tf),tf)  +  /  L(x,u,t)dt  (3.9) 

u’v  Jto 

Subject  to  the  constraints, 

x(t)  =  f(x,u,t)  +  h(x,u,t)v  (3.10) 


v(t)  =  ^2ci5(t-ti)  (3.11) 

i 

•  Communication  with  constraints  among  UAVs  as  a  bandwidth-limited  sig¬ 
nal 

Here  the  information  flow  and  communication  constraints  between  UAVs  is  modeled  as 
a  function 


v(t)  =  ~  **)  -  1(*  -  hi+ i)),  tj+ 1  -tj  >T  (3.12) 

i 

where  g(t)  is  a  piecewise  continuous  function,  and  again  the  time  interval  between  in¬ 
formation  flow  is  greater  than  some  constant  T.  Again  the  UAV  cooperative  control  is 
formulated  as  in  part  (a)  with  the  constraint  (3.11)  replaced  by  the  new  constraint  (3.12). 

•  Communication  with  constraints  among  UAVs  as  a  range-limited  signal 

Here,  the  information  flow  constraints  over  a  wide  geographical  area  with  geographical  con¬ 
straints  is  modeled  as  a  range-limited  function 


g(t),  C{x)  >  0 
0 ,  C(x)  <  0 


(3.13) 
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where  again  g(t)  is  a  piecewise  continuous  function,  and  v(t)  is  limited  information  from 
outside  the  UAV.  Again  the  UAV  cooperative  control  problem  is  formulated  as  before  but 
with  the  new  constraint  in  (3.13). 

The  necessary  conditions  for  the  existence  of  the  optimal  control  actions  for  all  the  three 
above  constrained  optimal  UAV  cooperative  control  problems  are  also  derived  by  the  author 

m.  . 

In  [46],  the  authors  have  considered  the  problem  of  cooperative  search  and  task  response 
in  a  team  of  UAVs  with  limited  communications.  The  UAVs  are  engaged  in  a  mission  to 
search  and  verifiably  destroy  targets  in  an  uncertain  environment  while  they  cooperate  in  two 
ways:  1)  by  sharing  information  among  the  team;  and  2)  by  coordinating  their  tasks.  The 
decentralized  system  described  by  the  authors  requires  the  specification  of  three  components: 

(i)  The  information-sharing  policy  (ISP):  Which  should  answer  the  fundamental 
question  of:  Who  communicates  what  to  whom,  when  and  how? 

(ii)  The  information  fusion  policy  (IFP):  Which  answers  the  question  of:  How  is 
received  information  combined  with  the  existing  subjective  information  base  (SIB)? 

(iii)  The  decision-making  algorithm:  Which  answers:  How  does  each  UAV  use  its  SIB 
to  make  its  decisions? 

The  main  contribution  the  above  work  in  [46],  is  the  definition  and  devise  of  the  above 
three  components  (i.e.  ISP,  IFP,  and  decision-making  algorithm)  with  the  objective  of  bring¬ 
ing  the  UAV  team’s  performance  as  close  as  possible  to  that  achieved  by  the  centralized  al¬ 
gorithm  with  noise-free,  instantaneous  communication  (i.e.  unconstrained  communication). 

Graph  Theory  Representation  of  the  Communication  Topology 

In  the  work  presented  in  [42],  [45],  the  authors  propose  a  graph  theory  representation  for 
information  exchange  and  communication  among  UAVs.  Although  the  work  is  done  under 
the  special  case  of  decentralized  formation  flight  control  and  management  but  we  believe  that 
the  same  idea  could  be  extended  to  the  more  general  case  of  UAV  cooperative  teams.  In  this 
paradigm,  the  information  exchange  between  UAVs  can  be  point-to-point  or  broadcast.  By 
contrast  to  the  former  case,  in  the  latter  one,  every  UAV  receives  and  sends  data  to  all  the 
others.  However,  in  both  cases,  the  UAVs  can  be  though  of  as  the  nodes  of  a  graph  while  the 
physical  communication  channels  create  the  arcs  in  the  graph.  The  arcs  are  assumed  to  be 
oriented  since,  in  the  most  general  case,  channels  are  not  bidirectional.  The  communication 
graph  should  be  redundant  from  the  viewpoint  of  the  information  flow  capability.  This 
redundancy  makes  reconfiguration  feasible  in  the  event  of  communication  faults.  Some  of 
the  possible  reconfiguration  techniques  are  described  in  the  later  sections. 

Optimal  Communication  Channels  among  UAVs 

Having  the  capability  of  using  a  channel  does  not  mean  that  it  must  be  used  at  all  times.  In 
other  words,  among  the  many  different  configurations  that  can  be  found  in  a  UAV  commu¬ 
nication  graph,  only  a  few  of  them  may  provide  good  performance.  Thus,  even  without  any 
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communication  faults,  there  should  be  some  algorithm  for  the  specification  of  the  optimal 
selection  of  the  available  communication  channels  to  be  used  for  propagating  information 
among  the  UAVs  in  the  formation.  The  authors  in  [18]  have  proposed  an  approach  for 
communication  channels  optimization  via  graph  programming  techniques. 

To  implement  the  optimization  technique,  a  weight  must  be  assigned  to  each  arc  in  the 
graph.  Then  the  Optimization  algorithm  will  minimize  the  total  cost  of  the  information  paths 
throughout  the  formation  using  the  arcs’  weights  to  evaluate  the  cost  of  a  connection.  The 
arcs’  weights  can  be  chosen  depending  on  various  criteria  such  as: 

•  Capability  of  the  formation  control  system  to  maintain  constant  inter-UAV  distances. 
A  measure  of  control  effort  or  closed-loop  distance-keeping  performance  can  be  used 
to  set  the  link  weight. 

•  Formation  safety:  using  distance  references  with  adjacent  UAV  might  limit  the  risk  of 
UAV  conflicts  compared  to  using  a  common  reference  for  all  UAVs. 

•  If  a  non-radio-based  or  a  non-omni  directional  communication  channel  is  used,  the 
geometry  of  the  formation  might  influence  the  possibility  of  exchanging  data  between 
two  UAVs  that  are  not  closely  spaced  or  hidden  by  the  others. 

Authors  in  [47]  have  proposed  the  deterministic  Dijkstra  algorithm  for  the  solution  of 
the  communication  channels  optimization  problem. 

3.2.2  FDIR  of  Information  Flow  Faults  in  Cooperative  UAVs 

Although  the  design  of  a  reliable,  high  performance  wireless  communication  scheme  for 
cooperative  UAV  control  is  still  a  quite  challenging  problem,  however,  from  the  control  en¬ 
gineering  point  of  view,  the  research  issue  of  interest  in  this  project  is  the  design  of  a  fault 
tolerant  control  scheme  using  the  best  available  wireless  communication  tools.  This  fault 
tolerant  scheme  should  be  capable  of  (i)  detecting  any  communication  fault  autonomously 
and  (ii)  autonomously  reconfiguring  the  mission  controller  or  the  communication  channel 
among  the  UAVs,  using  any  of  the  existing  hardware  or  software  redundancies,  to  fulfill 
the  mission  objectives.  However,  there  are  still  only  a  few  works  reported  in  the  literature 
regarding  the  design  of  an  efficient  FDIR  scheme  for  the  communication  faults  of  a  cooper¬ 
ative  UAV  control  (i.e.  fault-tolerant  UAV  control)  problem.  The  major  works  that  have 
been  reported,  and  will  be  described  in  more  detail  in  section  3.2.2,  are  in  the  specific  area 
of  flight  formation.  These  include  the  works  done  in  [47],  [18]  in  communication  channel 
reconfiguration  in  the  presence  of  some  classes  of  communication  faults  and  the  work  done 
in  [18]  which  addresses  the  communication  blackout  detection  and  isolation  in  the  formation 
flight  control  problem.  It  should  be  emphasized  that  to  the  best  of  our  knowledge  there  is  no 
work  reported  in  the  literature  to  date,  that  considered  the  FDIR  issue  in  UAV  cooperative 
control  problem  in  the  presence  of  both  low-level  and  communication  faults. 

Characterization  of  Information  Flow  Faults 

In  the  most  general  terms,  a  communication  fault  can  be  defined  as  the  temporary  or  per¬ 
manent  loss  of  information  exchange  capability  in  one  or  more  UAVs  in  a  cooperative  UAV 
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control  problem.  The  information  exchange  (or  communication)  capability  is  provided  by 
transmitter  (TX)  and  receiver  (RX)  devices  on  each  UAV.  It  is  also  clear  that  the  physical 
loss  of  a  UAV  itself  is  a  communication  fault  since  both  the  receiving  and  sending  information 
capability  are  lost.  Based  on  the  above  definition,  we  can  broadly  classify  the  communication 
faults  into  the  two  following  categories: 

•  Temporary  faults:  The  communication  capability  may  be  lost  for  only  a  limited 
period  of  time.  The  time  duration  of  temporary  fault,  however,  is  an  important  factor 
in  the  cooperative  control  problem.  The  temporary  faults  may  happen  due  to  several 
reasons  such  as  the  presence  of  obstacles  between  UAVs,  the  very  large  distances  (larger 
than  the  specified  communication  range)  that  may  temporarily  exist  among  UAVs,  the 
existence  of  highly  noisy  environments  or  the  radar  jamming  (conducted  by  the  enemy) 
in  only  some  sub-areas  of  the  terrain  that  the  UAV  teams  operate  in,  or  un-successful 
transmission  or  receiving  of  a  data  packet  for  limited  sampling  times. 

•  Permanent  faults:  The  communication  capability  of  one  or  more  nodes  in  the  UAV 
team  is  lost  for  the  rest  of  the  mission.  In  the  presence  of  such  kind  of  faults,  especially 
in  the  case  of  UAV  flight  formation,  some  UAV  reconfiguration  algorithm  like  the  one 
presented  in  [36]  should  be  initiated  in  order  to  maintain  the  team  operative.  The 
permanent  faults  may  occur  due  to  several  factors  such  as  the  permanent  loss  of  the 
receiver,  the  permanent  loss  of  the  transmitter,  the  loss  of  the  UAV,  or  the  sudden 
initiation  of  radar  jamming  (conducted  by  enemy)  in  almost  all  the  terrain  that  the 
UAVs  conduct  their  mission. 

From  another  viewpoint,  the  communication  faults  can  be  originated  due  to  the  following 
sources  of  faults: 

•  Transmitter  (TX)  fault:  This  may  take  place  due  to  the  electronic  malfunctioning 
of  the  transmitter  device,  power  blackout  in  the  transmitter  unit,  or  the  physical 
destruction  of  the  transmitter  antenna,  for  example,  due  to  an  attack. 

•  Receiver  (RX)  fault:  The  fault  in  the  receiver  may  happen  due  to  the  similar  reasons 
as  mentioned  for  the  transmitter. 

•  Partial/Full  data  packet  loss:  This  type  of  fault  represents  the  missing  of  the  full 
data  packet  for  some  sampling  times  in  the  receiver  end  although  it  has  been  sent 
correctly  by  the  transmitter,  or  the  loss  or  change  of  only  some  bits/symbols  in  the 
data  packet  arriving  at  the  receiver  end.  This  type  of  fault  may  happen  due  to  some 
stochastic  sources  like  the  high  levels  of  environmental  noise  or  deterministic  reasons 
like  radar  jamming  conducted  by  the  enemy.  In  the  case  of  partial  loss  of  data,  the 
significance  of  the  bits/symbols  lost  plays  a  crucial  role  in  the  UAV  cooperative  control 
problem.  For  example,  in  a  formation  flight  control  problem,  the  loss  of  bits  or  symbols 
representing  some  other  UAVs’  positions  data  can  cause  significant  difficulties  for  the 
formation  controller  while  the  loss  of  some  other  bits  may  not  be  that  significant. 

•  UAV  loss:  This  type  of  fault  essentially  happens  due  to  the  physical  destruction  of 
the  whole  UAV.  Thus,  one  node  of  the  inter-UAV  communication  network  would  be 
lost  forever. 
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Physical  Implication  of  Faults  In  section  3.2.2,  we  tried  to  justify  the  physical  implica¬ 
tions  and  sources  of  different  types  of  communication  faults  in  a  rather  comprehensive  way. 
As  stated  therein,  the  radar  jamming  is  considered  as  the  source  of  many  different  commu- 
'  nication  fault  scenarios.  So  it  might  be  helpful  to  gain  a  basic  understanding  of  the  radar 
jamming  mechanisms.  In  general,  the  techniques  that  limit  the  effectiveness  of  an  oppo¬ 
nent’s  communications  and/or  detection  equipment  are  called  ‘jamming’  [43].  The  jamming 
techniques  can  be  broadly  classified  into  the  following  three  classes  of  applications: 

•  Radio  jamming 

-  •  Radar  jamming 

•  Cell  phone  jamming 

Of  particular  interest  to  UAV  team  communication  is  the  radar  jamming  technique(s).  By 
definition  [43]  ,  Radar  jamming  is  the  intentional  emission  of  radio  frequency  signals  to  in¬ 
terfere  with  the  operation  of  a  radar  by  saturating  its  receiver  with  false  information.  There 
are  basically  two  types  of  radar  jamming,  namely,  mechanical  and  electronic  jamming. 

Mechanical  jamming  is  caused  by  devices  which  reflect  or  re-reflect  radar  energy  back 
to  the  radar  to  produce  false  target  returns  on  the  operator’s  scope.  Mechanical  jamming 
devices  include  chaff,  corner  reflectors,  and  decoys  [43]. 

Electronic  jamming  is  a  form  of  electronic  attack  where  jammers  radiate  interfering  sig¬ 
nals  toward  the  enemy’s  radar  blocking  the  receiver  with  highly  concentrated  energy  signals. 
The  four  existing  types  of  electronic  jamming  are  spot,  sweep,  barrage,  and  repeater/ spoof er 
jamming  [43]. 

Information  Flow  Fault  Recovery 

After  a  fault,  one  or  more  connections  could  be  lost  and  a  new  channel  configuration  must 
be  found  or  otherwise  the  cooperative  control  tasks  should  be  reconfigured  to  recover  the 
mission.  The  algorithm  for  the  re-optimization  of  the  inter-UAV  connection  and  the  control 
reconfiguration  algorithm  are  triggered  by  the  fault  detection,  and  they  are  essentially  de¬ 
centralized  for  faster  reconfiguration  time.  Also,  only  the  information  that  is  strictly  needed 
for  the  reconfiguration  process  must  be  exchanged  on  the  operating  data  channels.  The 
reconfiguration  process  must  arrive  to  the  same  result  on  all  UAVs;  that  is,  the  local  copy  of 
the  graph  describing  the  information  communications  must  be  identical  in  all  UAVs  at  all 
times. 

There  are  some  cases  (like  the  UAV  loss  fault),  however,  that  after  a  reconfiguration  of 
the  inter-UAV  connections,  a  geometrical  reconfiguration  of  the  UAVs  is  needed  as  well.  The 
authors  in  [47]  have  described  a  set  of  heuristic  rules,  implemented  through  several  schemes, 
called  reconfiguration  maps  (RMs)  for  the  purpose  of  geometrical  reconfiguration  of  the 
formation.  Although  their  work  has  been  done  for  a  special  case  of  leader-follower  formation 
in  the  UAV  formation  control  problem,  the  same  idea  can  be  extended  to  a  cooperative  UAV 
control  problem. 
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The  Hardware  Redundancy  Considerations  In  the  event  of  communication  fault  some 
hardware  redundancies  are  usually  predicted  in  order  to  provide  information  regarding  at 
least  the  other  UAVs’  positions  which  is  variable  of  critical  importance  in  cooperative  UAV 
control.  These  redundancies  are  implemented  through  on-board  AFF  (Autonomous  Forma¬ 
tion  Flyer)  type  sensors  that  measure  inter-UAV  distances.  In  other  words,  in  the  presence 
of  a  transmission  fault  the  follower  estimates  the  state  of  the  leader  using  its  current  estimate 
and  the  measurement  of  their  relative  position  provided  by  onboard  sensors.  In  the  case  of 
UAV  formation  flight  the  measurement  of  the  relative  position  can  also  be  provided  by  the 
use  of  sensors  such  as  camera,  infra-red,  or  laser  mounted  on  the  follower  vehicle  and  a  target 
such  as  pattern,  light,  or  reflector  on  the  lead  UAV.  Although  this  requires  more  additional 
hardware  but  it  is  simple,  robust,  and  immune  to  jamming.  Also  differential  carrier  phase 
GPS  can  be  used  to  get  relative  position  with  more  precision.  For  example,  in  the  GTMax 
research  UAV  system  [39]  developed  at  the  Georgia  Institute  of  Technology  to  support  the 
Software  Enabled  Control  (SEC)  program  launched  by  DARPA  and  AFRL,  the  basic  system 
hardware  includes  a  general-purpose  computer,  Differential  GPS  (D-GPS),  an  inertial  mea¬ 
surement  unit,  an  ultrasonic  altimeter,  a  three-axis  magnetometer,  and  two  wireless  data 
links.  Other  flight  configurations  used  to  date  have  also  utilized  cameras,  a  radar  altimeter, 
and  video  capture/compression  hardware.  The  basic  ground  equipment  includes  the  data 
links  and  a  GPS  reference  station. 

Software  Redundancy  &c  Communication  Channel  Reconfiguration  Although  the 
hardware  redundant  sensors  can  be  used  in  the  case  of  communication  fault,  but  in  many 
situations  they  are  not  considered  as  the  first  choice  of  communication  fault  recovery.  In 
other  words,  it  is  more  desirable  to  exploit  the  software  redundancies  as  the  first  solution.  For 
example,  in  order  to  decrease  the  probability  of  partial  data  packet  loss,  a  data  packet  can 
be  sent  more  than  once  using  the  possible  extra  bandwidth  of  the  communication  channel. 
Obviously,  the  time  between  two  transmissions  of  a  single  data  pack  should  be  smaller  than 
the  sampling  time  of  the  sensory  data  of  the  UAVs.  Authors  in  [18]  have  also  proposed 
the  issue  of  redundant  channels  as  a  recovery  technique  to  the  occurrence  of  communication 
faults  of  TX  fault,  RX  fault,  and  UAV  loss  in  the  autonomous  flight  formation  problem. 
They  use  a  graph  theory  approach  (modified  Dijkstra  algorithm)  to  optimally  reconfigure 
the  communication  channel  after  a  fault  has  occurred.  Using  this  algorithm  the  optimal 
redundant  communication  channel  among  UAVs  is  found.  However,  they  still  use  a  separate 
Broadcast  Channel  (BC)  to  keep  all  the  UAVs  informed  of  what  is  happening  on  a  specific 
node  of  the  UAVs  communication  network  [47].  The  information  carried  on  the  BC  is  in 
fact  vital  to  the  coordination  of  the  formation  whenever  required  (for  example,  in  case  of  a 
UAV  loss).  Thus,  the  use  of  BC  communication  is  quite  more  extensive  during  a  post-fault 
recovery  procedure.  The  authors  in  [48],  have  also  proposed  the  inter-UAV  communication 
Fault  Detection  and  Isolation  (FDI)  scheme  based  on  the  Interacting  Multiple  Model  (IMM) 
approach.  However,  the  class  of  communication  faults  that  they  consider  is  limited  to  the 
general  case  of  communication  blackout.  Furthermore,  they  don’t  propose  any  fault  recovery 
algorithm  for  post  fault  operation  of  UAVs. 
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Chapter  4 

Model-Based  Fault  Detection, 
Isolation  and  Recovery 


4.1  Nonlinear  Geometric  Fault  Detection  and  Isolation 
Approach 

In  the  following,  the  method  presented  in  [49]  is  briefly  reviewed,  which  gives  us  the  necessary 
and  sufficient  conditions  for  solving  the  problem  of  detecting  and  isolating  faults  for  nonlinear 
systems.  The  reader  may  refer  to  [49]  for  all  the  details  and  further  information.  The 
mathematical  concepts  and  definitions  may  be  found  in  [50] .  The  essential  parts  of  the  work 
in  [49]  are  reviewed  here.  It  is  assumed  that  the  nonlinear  system  can  be  described  by  the 
following  model: 


x  =  f(x)  +  g(x)u  +  l(x)mi  +  p{x)w 

V  =  h(x)  (4.1) 


with  state  x  defined  in  a  neighborhood  X  of  the  origin  in  Rn,  inputs  u  £  FF1,  mi  £  R, 
w  £  Rd  and  output  y  £  Rq ,  in  which  f  (x),  the  m  columns  gi(x),  ...,gm(x)  of  g(x),  l(x),  and 
d  columns  pi(x),  ...,pd(x)  of  p(x)  are  smooth  vector  fields,  h(x)  is  a  smooth  mapping  and 
/( 0)  —  0,  h( 0)  =  0.  The  notations  u,  m i,  and  w  of  the  input  of  (4.1)  denote  the  input 
channel  for  the  control  purposes,  the  fault  signal,  and  the  disturbance  signal,  respectively. 

By  ignoring  the  faults  and  disturbances  momentarily,  then  (4.1)  becomes 

771 

*  =  go(x)  +  y^jgi(x)ui 

i=  1 

V  =  h(x)  (4.2) 


where  g0(x)  =  f{x). 

Definition  4.1.1.  Let  U  be  an  open  set  in  Rn.  Then  the  set  of  smooth  functions  with  compact 
support  (in  U)  is  the  set  of  functions  /  :  Rn  — >  C  which  are  smooth  (i.e.,  daf  :  —>  C  is  a 

continuous  function  for  all  multi- indices  a)  and  supp(/)  is  compact  and  contained  in  U  [51]. 
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Definition  4.1.2.  Suppose  U  is  an  open  set  in  Rn ,  and  suppose  D(U)  is  the  topological 
vector  space  of  smooth  functions  with  compact  support.  A  distribution  is  a  linear  continuous 
functional  on  D(U),  i.e.,  a  linear  continuous  mapping  D(U)  — »  C  [51]. 

Definition  4.1.3.  Let  T  :  V  — >  W  be  a  linear  transformation.  The  set  of  all  vectors  in  V 
that  T  maps  to  0  is  called  the  kernel  (or  nullspace )  of  T,  and  is  denoted  KerT.  When  the 
transformations  are  given  by  means  of  matrices,  the  kernel  of  the  matrix  A  is 

KerA  —  {x  €  V  \ Ax  =  0} 

Definition  4.1.4.  Given  a  distribution  A,  the  distribution  that  is  the  smallest  involutive 
distribution  containing  A  is  called  the  involutive  closure  of  A  [50]. 

Corresponding  to  (4.2),  a  distribution  A  is  called  conditioned  invariant  if  it  conforms 

[&,  A  fl  Ker  { dh }]  C  A,  i  —  0,  . . . ,  m  (4.3) 

Further,  we  let  P  =  span{pi(x),  ...pd(x)},  and  propose  a  nondecreasing  sequence  of 
distributions  as  following: 

S0  =  P 

m 

Sk+1  =  sk  +  [gi,  Sk  n  Ker  {dh}]  (4.4) 

i=0 

where  S  denotes  the  involutive  closure  of  S.  Suppose  there  is  an  integer  k*  such  that 

5fc.+i  =  Sk  (4.5) 

and  let  ^  f  =  Sfe» .  Thus,  ^  f  is  involutive,  contains  P  and  is  conditioned  invariant. 

Let  0  be  a  fixed  codistribution  and  define  the  following  nondecreasing  sequence  of  codis¬ 
tributions 


Qo  =  0  H  span  {dh} 

/  m 

Qk+1  =  0  n  ^  LgiQk  +  span  {dh} 


Suppose  all  the  codistributions  of  this  sequence  are  nonsingular,  so  that  there  is  an  integer 
k*  <  n  —  1  such  that  Qk  —  Qk*  for  k  >  k*,  and  set  Q*  =  Qk ».  Then,  it  is  convenient  to  use 
the  notation 

fl*  =  o.c.a.  (0) 

where  “o.c.a.”  stands  for  “observability  co distribution  algorithm”. 

Based  on  the  properties  (as  discussed  in  details  in  [49])  of  the  two  sequences  (4.4)  and 
(4.6),  if  (4.6)  is  initialized  at  (X^f)X>  then  o.c.a.  ((]Cf)X)  is  the  largest  observability 
codistribution  which  is  locally  spanned  by  the  exact  differentials  and  contained  in  PL . 
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According  to  [49] ,  the  necessary  condition  for  solving  the  nonlinear  fundamental  problem 
of  residual  generation  is: 

(spcm{Z})x  4-o.c.o.  'SJ=T*X  (4.7) 

Furthermore,  if  the  condition  (4.7)  holds,  then  we  could  possibly  perform  coordinate 
transformations  in  the  states  leading  to  the  new  output  that  characterizes  an  observable 
subsystem  upon  which  it  is  possible  to  design  a  residual  generator  unaffected  by  all  faults 
but  one. 

Definition  4.1.5.  Suppose  there  is  an  open  subset  U  of  Rn.  The  differential  or  gradient  of 
a  real- valued  function  A(x)  on  U,  denoted  d\)  is  the  lxn  row  vector  whose  z-th  element  is 
the  partial  derivative  of  A  with  respect  to  x*.  Its  value  at  a  point  x  is  thus 


d\(x)  =  (R-  |i  ... 

\<9xi  dx2  dxn) 

Definition  4.1.6.  A  function  /  :  X  — *  Y  is  called  surjection  if,  for  every  y  G  V,  there  is  an 
i£l  such  that  /(x)  =  y. 

Consider  the  nonlinear  system  dynamics  that  is  governed  by  (4.2).  Let  ft  be  an  observ¬ 
ability  codistribution,  and  n3  be  the  dimension  of  f l.  When  ft  is  calculated  according  to  the 
sequences  (4.4)  and  (4.6),  (4.6)  is  initialized  at  (X)  f )  ^  and  ft  can  be  spanned  by  the  exact 
differentials. 

Suppose  that  span  { dh }  is  nonsingular.  Let  p—n2  denote  the  dimension  of  ft  C\  span  {dh}, 
and  suppose  there  exists  a  surjection  \Eq  :  RP  — >  Rp~n2  such  that 

ft  <1  span  {dh}  =  span  {d  3  o  h)}  (4.8) 

Fix  x°  G  X  and  let  y°  =  h(x°).  Then,  there  exists  a  selection  matrix  H2  such  that 

*  ^  =  (  ll  )  =  (  )  (4'9) 

Choose  a  neighborhood  U°  of  x°  and  a  function  4>i:  U°  — >  Rni  such  that 

ft,  =  span  {d$i}  (4-10) 

at  any  point  of  U°.  Then,  there  exists  a  function  <f>3  :  U°  — >  Rn~n  1-712  such  that 

/  X!  \  (  $1  (x)  \ 


4>  (x)  =  x2 


H2h(x) 
4*3  (x) 


(4.11) 


is  a  local  diffeomorphism  at  x°  in  X.  By  applying  this  diffeomorphism  to  system  (4.1),  then 
system  (4.1)  becomes  equivalently: 


x\  =  fi(xi,x2)  +  gi(xi,x2)u  +  h(xi,x2)mi,  xi  G  Rni 

X2  =  f2(xi,x2,x3)  +  g2(xi,x2,x3)u  +  p1(x1,x2,x3)w,x2  G  Rn2 

X3  =  fs{x\ ,  x2,  x3)  +  ^3(xx,  x2,  x3)u  +  p2(x I,  x2,  x3)w,  x3  G  Rn~n  1_nz 

yi  =  ^(xi),?/!  g  RP~n2 

y2  =  x2,y2eRn2  (4.12) 
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Following  the  state  space  coordinate  transformation,  the  disturbances  w  can  only  affect 
xi-subsystem  through  x2.  However,  since  we  observe  x2  through  y2,  one  may  view  x2  as 
an  input  to  the  xx -subsystem.  The  problem  of  detecting  and  isolating  faults  in  the  original 
nonlinear  system  (4.1)  reduces  to  that  of  designing  a  residual  generator  for  the  observable 
subsystem  [49].  However,  either  designing  an  estimator  for  the  states  of  the  system  or  its 
parameters  require  that  the  states  of  the  system  be  uniformly  bounded.  Thus,  if  the  open- 
loop  system  is  not  guaranteed  to  be  state  bounded,  one  has  to  design  a  controller  to  make 
the  system  stable  and  state  bounded.  More  importantly,  when  actuator  faults  occur,  it 
is  clear  that  the  existing  controllers  will  not  work  and  the  states  will  diverge  most  likely. 
Therefore,  it  is  imperative  that  as  soon  as  one  detects  the  faults,  one  initiates  the  trigger  for 
the  redundant  actuators  for  compensating  the  presence  of  faults.  The  difficulty  that  one  is 
faced  with  is  that  one  cannot  control  the  system  from  the  time  the  faults  occur  to  the  time 
the  faults  are  detected.  Therefore,  there  is  a  necessary  condition  for  designing  a  residual 
generator  for  the  observable  subsystem.  Specifically,  the  system  should  contain  no  finite 
escape  time. 

Based  on  the  above  review  of  the  fault  diagnosis  of  nonlinear  systems,  the  main  contri¬ 
bution  of  this  thesis  is  to  design  a  desirable  residual  generator  for  the  observable  subsystem. 
Our  approach  is  based  on  parameter  estimation.  The  actuator  faults  are  viewed  and  con¬ 
sidered  as  changes  of  the  parameters.  A  nonlinear  estimator  is  designed  to  identify  these 
parameters  and  the  estimators  are  treated  as  the  residual  generators.  The  proposed  new 
residual  generators  are  applied  to  two  different  dynamical  models  namely,  satellite  orbital 
model  and  satellite  attitude  control  model. 

4.1.1  Isolation  of  Concurrent  Faults 

For  the  nonlinear  system  (4.1),  there  is  only  one  possible  fault  m\.  In  this  section,  we  will 
discuss  the  case  in  which  there  are  possibilities  of  multiple  concurrent  faults.  The  key  idea 
of  isolating  concurrent  faults  is  to  design  a  residual  generator  for  each  possible  fault,  where 
this  residual  generator  is  unaffected  by  all  the  faults  except  one  fault.  Consider  the  system 

m  s 

X  —  f(x)  +  gi(x)ui  +  ^2  U(x)mi  +  p(x)w 

i= 1  i=l 

y  =  h(x)  (4.13) 

where  there  are  now  s  possible  faults.  For  2=1,. .. ,  s,  set 

Pi  (^1  '  ’  '  li— 1  li+1  '  Is  P) 

Wi  =  col  (mi,  •  ■  •,  m;_i,  mi+1,  ■  ■  •,  ms,  w ) 

Then,  system  (4.13)  can  be  rewritten  as 

m 

x  =  /(x)  +  ^5i(x)iij  -I-  li(x)rrii  +  pi(x)wi 

i=  1 

y  =  h(x)  (4.14) 
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Let  Pi  =  span  {pi},  so  that  we  can  use  nondecreasing  sequence  (4.4)  and  (4.6),  where 
(4.4)  is  initialized  at  P*  and  (4.6)  is  initialized  at  (Sf4)  >  to  find  the  largest  observabil¬ 
ity  codistribution  which  is  locally  spanned  by  the  exact  differentials  and  contained  in  Pl±- 
Further,  if  this  observability  co distribution  satisfies  (4.7),  we  may  transform  the  coordinates 
to  have  an  observable  subsystem  upon  which  it  is  possible  to’  design  a  residual  generator 
affected  only  by  mj.  If  one  can  design  such  a  residual  generator  for  each  mi  (i=l,. . . ,  s),  one 
in  effect  can  isolate  these  concurrent  faults. 

4.1.2  Step  by  Step  details  of  the  Nonlinear  FDI  approach 

In  this  section,  design  steps  of  nonlinear  geometric  FDI  algorithms  are  summarized.  Consider 
nonlinear  system  4.1  and  a  problem  of  generating  a  residual  signal  that  is  affected  by  fault  m\ 
and  is  decoupled  from  w.  Design  step  for  FDI  algorithm  for  this  problem  may  be  summarized 
as: 

(i)  For  P  =  span  {pi(x),  ...pd{x)},  find  using  a  nondecreasing  sequence  of  distribution 
in  (4.4). 

(ii)  Find  the  observability  codistribution  o.c.a((52f)±)  using  (4.6). 

(iii)  Check  the  necessary  condition  (4.7),  if  it  does  not  hold,  the  problem  does  not  have  a 
solution. 

(iv)  If  (4.7)  holds,  then  one  should  find  a  function  dq  that  satisfies  (4.10).  This  function 
can  be  found  solving  the  corresponding  partial  differential  equation.  For  example  let 
Q  =  o.c.a((5^„  )-L)  =  P1-  with  dimension  n\  (this  will  happen  when  there  is  full  state 
measurement),  then  one  should  solve  following  PDEs 

dX(x).pi(x)  =  0 
dX(x).p2(x)  =  0 


dX  (x).pd(x)  =  0 


(4.15) 


Since  Cl  is  involutive,  there  should  be  nx  solutions  A^x),  A2(x), ...,  Ani(x)  for  above 
PDE.  Then 

(  Ai(z)  \ 


$i(x)  - 


A2(z) 


Ani(z) 


(4.16) 


(v)  Find  a  surjection  that  satisfy  (4.8)  and  selection  matrix  H2  such  that  is  output 
diffeomorphism . 

(vi)  Find  the  state  diffeomorphism  $  from  (4.11)  and  the  new  state  equation  of  the  system 
(4.1)  as  (4.12). 
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(vii)  Design  an  observer  for  the  x\  subsystem  of  (4.12)  by  considering  x2  =  y2  as  an  inde¬ 
pendent  input. 

4.2  Fixed-Wing  UAV  FDI 

4.2.1  Fixed  Wing  UAV  Models 

References  [3,  52]  discuss  the  basic  concepts  of  the  fixed-wing  aircraft  dynamics.  In  this 
subsection,  the  axes  of  aircraft  motions,  main  control  surfaces,  and  fixed-wing  models  will 
be  presented. 

Dynamic  Motions  [3] 

The  unsteady  motions  of  an  airplane  can  frequently  be  separated  for  convenience  into  two 
parts.  One  of  these  consists  of  the  longitudinal  or  symmetric  motions;  that  is,  those  in  which 
the  wings  remain  level,  and  in  which  the  center  of  gravity  moves  in  a  vertical  plane.  The 
other  consists  of  the  lateral  or  asymmetric  motions;  that  is,  rolling,  yawing,  and  sideslipping, 
while  the  angle  of  attack,  the  speed,  and  the  angle  of  elevation  of  x  axis  remains  constant. 

Main  Control  Surfaces 

The  main  control  surfaces  are  attached  to  the  airframe  on  hinges  so  they  may  move  and 
deflect  the  air  stream  passing  over  them.  This  redirection  of  the  air  stream  generates  an 
unbalanced  force  to  rotate  the  plane  about  the  associated  axis. 

•  Ailerons  -  Ailerons  are  mounted  on  the  back  edge  of  each  wing  near  the  wingtips,  and 
move  in  opposite  directions.  When  the  pilot  moves  the  stick  left,  or  turns  the  wheel 
counter-clockwise,  the  left  aileron  goes  up  and  the  right  aileron  goes  down.  A  raised 
aileron  reduces  lift  on  that  wing  and  a  lowered  one  increases  lift,  so  moving  the  stick 
left  causes  the  left  wing  to  drop  and  the  right  wing  to  rise.  This  causes  the  plane  to 
bank  left  and  begins  to  turn  to  the  left.  Centering  the  stick  returns  the  ailerons  to 
neutral  maintaining  the  bank  angle.  The  plane  will  continue  to  turn  until  opposite 
aileron  motion  returns  the  bank  angle  to  zero  to  fly  straight. 

•  Elevators  -  An  elevator  is  mounted  on  the  back  edge  of  the  horizontal  stabilizer  on 
each  side  of  the  fin  in  the  tail.  They  move  up  and  down  together.  When  the  pilot 
pulls  the  stick  backward,  the  elevators  go  up.  Pushing  the  stick  forward  causes  the 
elevators  to  go  down.  Raised  elevators  push  down  on  the  tail  and  cause  the  nose  to 
pitch  up.  This  makes  the  wings  fly  at  a  higher  angle  of  attack  which  generates  more 
lift  and  more  drag.  Centering  the  stick  returns  the  elevators  to  neutral  and  stops  the 
change  of  pitch. 

•  Rudder  -  The  rudder  is  mounted  on  the  back  edge  of  the  fin  in  the  tail.  When  the 
pilot  pushes  the  left  pedal,  the  rudder  deflects  left.  Pushing  the  right  pedal  causes  the 
rudder  to  deflect  right.  Deflecting  the  rudder  right  pushes  the  tail  left  and  causes  the 
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nose  to  yaw  right.  Centering  the  rudder  pedals  returns  the  rudder  to  neutral  and  stops 
the  yaw. 

Other  Controls 

•  Flaps  -  Flaps  are  mounted  on  the  back  edge  of  each  wing  near  the  wing  roots.  They  are 
deflected  down  to  increase  the  effective  curvature  of  the  wing  and  produce  additional 
lift,  and  also  reduce  the  stalling  speed  of  the  wing.  They  are  used  during  low  speed, 
high  angle  of  attack  flight  like  descent  for  landing. 

•  Spoilers  -  On  very  high  lift/low  drag  aircraft  like  sailplanes,  spoilers  are  used  to  disrupt 
airflow  over  the  wing  and  greatly  reduce  the  amount  of  lift.  This  allows  a  glider  pilot 
to  lose  altitude  without  gaining  excessive  airspeed.  Spoilers  are  sometimes  called  ’’lift 
dumpers” . 

•  Elevon  -  An  elevon  is  an  aircraft  control  surface  that  combines  the  functionality  of  the 
elevator  (used  for  pitch  control)  and  the  aileron  (used  for  roll  control),  hence  its  name. 
It  is  frequently  used  in  tailless  aircraft  such  as  flying  wings.  There  will  be  one  or  more 
elevons  on  each  side  of  the  aircraft  at  the  trailing  edge  of  the  wing.  When  moved  in 
the  same  direction  (up  or  down)  they  will  cause  a  pitching  force  to  be  applied  to  the 
airframe.  When  moved  differentially,  (one  up,  one  down)  they  will  cause  a  rolling  force 
to  be  applied.  These  forces  may  be  applied  simultaneously  by  appropriate  positioning 
of  the  elevons. 

References  [3,  52]  investigate  the  fixed-wing  aircraft  dynamic  models.  Here,  the  results 
of  their  investigations  will  be  presented.  For  simplicity,  the  treatment  will  be  limited  to 
the  flat-Earth  equations  of  motion.  First,  the  vector  equations  will  be  expanded  with  the 
translational- velocity  state  equation  expressed  in  terms  of  velocity  components  in  the  aircraft 
body-fixed  system.  The  body-axes  equations  are  the  best  choice  for  general  flight  simulation. 
On  the  other  hand,  for  the  purposes  of  linearizing  the  equations  of  motion  and  studying  the 
dynamic  behavior,  it  is  better  to  have  the  velocity  equation  in  terms  of  stability  or  wind-axes 
variables:  airspeed  and  aerodynamic  angles. 

Body-axes  equations 
Force  equations 

X  —  mg  sin  9  =  m(u  +  qw  —  rv) 

Y  +  mg  cos  6  sin  0  =  m(v  +  ru  —  pw )  (4-17) 

Z  +  mg  cos  9  cos  (j)  —  m(w  +  pv  —  qu) 

Kinematics  equations 
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Z,i» 

'  'x 


Figure  4.1:  Notations  for  body  axes  [3] 


4>  =  p  +  tan  9  •  (q  sin  $  +  r  cos  4>) 

9  =  q  cos  <$>  —  r  sin  (f)  (4-18) 

<p  =  (q  sin  (j)  +  r  cos  <f>)  /  cos  9 

Moment  equations 

Lm  =  hp  +  hxr  ~  qr(Iz  -  Iy )  +  Izxpq 

Mm  =  Iyq  +  rp(Ix  -  Iz)  -  Izx(p2  -  r2)  (4.19) 

Nm  =  hr  +  IZxP  +  pq(Iy  ~  h)  -  hxQT 

Navigation  equations 

x  =  cos  9  ■  cos  ip  ■  u  +  (sin  (j>  ■  sin  9  ■  cos  <p  —  cos  <p  •  sin  </?)  •  v 

+  (cos  4>  ■  sin  9  •  cos  +  sin  <j>  ■  sin  </?)  •  w 
y  =  cos  9  •  sin  ip  ■  u  +  (sin  <f>  ■  sin  9  ■  sin  tp  +  cos  4>  •  cos  p>)  •  v 

+  (cos  (j)  ■  sin  9  •  sin  ip  —  sin  <f>  •  cos  p)  -w  (4.20) 

z  =  —  sin  9  •  u  +  sin  <f>  •  cos  9  •  v  +  cos  4>  •  cos  9  •  w 

where  m  is  the  mass  of  aircraft,  x ,  y,  and  z  are  positions  of  the  center  of  gravity  along  the 
x,  y,  and  2- axis  directions,  u,  v,  and  w  are  the  velocities  in  the  x,  y,  and  z-axis  directions, 
(f>,  9,  and  <p  are  roll,  pitch,  and  yaw  angles,  p,  q,  and  r  are  the  roll,  pitch,  and  yaw  rate,  X, 
Y,  and  Z  are  total  forces  along  the  x,  y,  and  2-axis  directions,  and  Lm,  Mm,  and  Nm  are 
total  rolling,  pitching,  and  yawing  moments,  as  shown  in  Fig.  5.  Also,  the  inertia  matrix  of 
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an  aircraft  is  defined  as: 


Ib  = 


Lx  Xxy 
lyx  ly 
I zx  Izy 


yz 


Longitudinal  Model  in  Wind  or  Stability- Axes  Equations 


Most  aircrafts  spend  their  flying  time  in  a  wings-level  steady-state  flight  condition,  and 
due  to  time  limitations,  only  the  longitudinal  model  [52]  in  a  wings-level  and  zero  sideslip 
angle  conditions  will  be  investigated  in  this  project.  Specifically,  the  equations  are  given  as 
follows: 


mVr  =  Ft  cos(a  +  aT)  —  D  —  mg  sin(7) 
m'yVr  —  FT  sin(a  +  aT)  +  L  —  mg  cos( 7) 

a  =  q-  7  (4.21) 

q  =  MmJIy 

where  Iy  denotes  the  ?/-body  axis  moment  of  inertia,  m  denotes  the  total  mass  of  the 
aircraft,  a  denotes  angle  of  attack,  Ft  denotes  the  engine  thrust,  aF  represents  the  angle 
formed  by  the  vector  of  the  engine  thrust  and  the  fuselage  reference  line,  7  denotes  the 
flight-path  angle,  q  is  the  pitch  rate,  Vt  represents  the  total  velocity  of  the  aircraft,  Mm 
denotes  pitching  moments  and  L  and  D  represent  the  lift  and  drag,  respectively. 

The  lift,  the  drag  and  the  pitching  moments  can  be  calculated  according  to: 


D  =  qSCD 

L  =  qSCL  (4.22) 

Mm  -  qScCm 

where  S  denotes  the  wing  platform  area,  c  represents  the  mean  aerodynamic  chord,  Co, 
Cl ,  and  Cm  are  drag,  lift  and  pitching  coefficients,  respectively,  and  q  denotes  the  dynamic 
pressure,  which  is  defined  by: 

Q  =  \pvt  (4.23) 

in  which  p  denotes  the  density  of  the  air,  and  it  varies  along  the  altitude  of  the  aircraft. 
Additionally,  at  certain  Mach  numbers  and  altitudes  it  is  assumed  that 

Ft  =  CFstSt  (4.24) 

where  CF&t represents  the  maximum  engine  thrust  the  aircraft  can  provide,  5t  denotes  the 
throttle  position,  which  varies  from  0  to  1,  that  is  0  <  8t  <  1.  Therefore,  combining  equations 
(4.21),  (4.22),  (4.23)  and  (4.24),  the  longitudinal  fixed-wing  model  can  be  rewritten  as: 
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mVr 

—  CfsA  cos(g:  +  Cut)  — 

m'yVr 

=  Cps^t  sin(o!  +  olt)  + 

a 

=  Q~  7 

Q 

pV*ScCm 

O  T 

^ pVtSCd  ~  mg  sin (7) 

^pV%SCL-mg  cos  (7) 


(4.25) 


The  modeling  problem  is  now  reduced  to  defining  the  lift,  drag  and  pitching  coefficients: 
Cd,  Cl,  and  Cm,  respectively.  Normally,  one  may  perform  numerous  experiments  on  a  spe¬ 
cific  aircraft  in  the  wind  tunnel  to  determine  these  coefficients  and  set  up  a  “lookup-table” 
in  the  aircraft  computers  since  these  coefficients  vary  according  to  different  flight  environ¬ 
ments  and  it  is  difficult  to  determine  explicit  closed-form  expressions  for  these  variations. 
However,  in  certain  defined  flight  environments,  these  behaviors  will  be  simpler  and  can  be 
expressed  explicitly.  In  this  project,  it  is  assumed  that  the  coefficients  Cd,  Cl,  and  Cm  have 
the  following  explicit  functional  dependencies  at  certain  Mach  numbers  and  altitudes,  that 
is: 


CD 

—  Cd{ol)  +  CdSs  $e 

(4.26) 

Cl 

=  Cl  (a)  +  C L8e 

(4.27) 

Cm 

c 

Cm(^)  OT/  CmqQ  “1“  Cmse5e 

Z  Vj1 

(4.28) 

where  5e  denotes  the  elevator  angle,  Cose  ,  Cl8s,  and  Cmse  are  all  constant  coefficients,  ( 
and  Cmq  denotes  pitch  damping  derivative.  The  functions  Cd{ol)i  Cl{ol),  and  Cm(a)  may  be 
expressed  explicitly  according  to  the  angle  of  attack  a.  Practically,  using  the  experimentally 
generated  “lookup-tables”,  one  may  perform  polynomial  regression  in  order  to  obtain  these 
explicit  functional  dependencies.  This  is  precisely  what  we  have  done  in  this  project. 

Polynomial  regression  for  Cd{ol) 


It  is  assumed  that  the  following  “lookup-table”  characterizing  Cd{ol)  for  a  certain  UAV 
at  the  Mach  number  of  0.8  is  available  [52]: 


Table  4.1:  States  of  the  UAV  corresponding  to  a  normal  mode 


,  Angle  of  attack  (a) 

-2° 

-1° 

HSU 

1° 

2° 

3° 

4° 

5° 

6° 

7° 

8° 

9° 

10° 

Cd{.<x) 

0.017 

0.017 

0.018 

0.019 

0.022 

0.025 

0.029 

0.034 

0.041 

0.047 

0.057 

0.065 

0.078 

A  number  of  polynomial  regressions  using  different  polynomial  orders  are  performed  as 
summarized  in  the  following  table  ( a  in  rad). 
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Table  4.2:  Detection  observer  residual  outputs  corresponding  to  a  normal  mode 


2nd  order 

/(a)  =  1.6545a2  +  0.0501a  +  0.0175 

IICdM  -  /Ml 

*  =  6.8032  x  10~6 

3rd  order 

/(a)  =  2.4114a3  +  1.1495a2  +  0.067a  +  0.0179 

HCk (a)  -  /(a) ||"  =  3.4186  x  10~6 

Ath  order 

/(a)  =  12.3757a4  -  1.0445a3  +  1.3784a2  +  0.0687a  +  0.0177 

\\CD(a)  -  f(a)\f  =  3.1548  x  lO”6 

5th  order 

/(a)  -  221.1889a5  -  64.8338a4  +  6.7039a3  +  1.2608a2 
+  0.0586a  +  0.0178 

IIMM-/MI 

z  =  2.9214  x  10"6 

In  this  report,  we  are  going  to  use  the  third  order  polynomial 

CD(a)  =  2.4114a3  +  1.1495a2  +  0.067a  +  0.0179  (4.29) 

where  the  Mach  number  is  0.8  and  —0.0349  <  a  <  0.1745. 

Polynomial  regression  for  C^a) 

It  is  assumed  that  the  following  “lookup-table”  characterizing  Cl(cx)  for  a  certain  UAV 
at  the  Mach  number  of  0.8  is  available: 

Table  4.3:  States  of  the  UAV  corresponding  to  a  float  fault  in  the  elevator  input  channel 


Angle  of  attack  (a) 

-2° 

-r 

0° 

1° 

2° 

3° 

4° 

5° 

6° 

7° 

8° 

9° 

10° 

CL(a ) 

0 

0.045 

0.095 

0.14 

0.19 

0.23 

0.28 

0.325 

0.37 

0.42 

0.46 

0.50 

0.54 

A  number  of  polynomial  regressions  using  different  polynomial  orders  are  performed  as 
shown  in  the  table  below  (a  in  rad): 


Table  4.4:  Detection  observer  residual  outputs  corresponding 


1st  order 

/(a)  =  2.6035a  +  0.0948 

||CL(a)  -  /(a)  4  =  2.3407  x  10~4 

2nd  order 

/(a)  =  —0.9019a2  +  2.7294a  +  0.0942 

JlC's(a)  -  /(a)||*  =  8.2967  x  lO”5 

In  this  report,  we  are  going  to  use  the  first  order  polynomial 

CL(a)  =  2.6035a  +  0.0948  (4.30) 

where  the  Mach  number  is  0.8  and  —0.0349  <  a  <  0.1745. 
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Polynomial  regression  for  Cm(a ) 


It  is  assumed  that  the  following  “lookup-table”  regarding  Cm(a )  for  a  certain  UAV  operating 
at  the  Mach  number  of  0.8  is  available: 

Table  4.5:  to  float  fault  in  the  elevator  input  channel 


Angle  of  attack  (a) 

-2° 

-1° 

0° 

1° 

2° 

3° 

4° 

5° 

6° 

7° 

8° 

9° 

10° 

Cm(a) 

-0.01 

-0.013 

-0.016 

-0.019 

-0.022 

-0.025 

-0.028 

-0.039 

-0.05 

-0.055 

-0.06 

-0.071 

-0.082 

A  number  of  polynomial  regressions  using  different  polynomial  orders  are  performed  as 
summarized  below  ( a  in  rad): 


Table  4.6:  Linear  detection  observer  residual  outputs  corresponding 


1st  order 

/(a)  =  —1.2889a"2  -  0.1588a  -  0.0148 

|| Cm(a)  -  /(a)  *  =  5.0773  x  10~5 

2nd  order 

/(a)  =  0.6577a3  -  1.4266a2  -  0.1542a  -  0.0147 

||Cm(a)  -  /(a)  |"  =  5.0521  x  10~5 

3rd  order 

/(a)  =  45.0696a4  -  11.9282a3  -  0.593a2  -  0.1479a  -  0.0154 

HC'm(a)  —  /(a)|  2  =  4.7023  x  10-5 

In  this  report,  we  are  going  to  use  the  second  order  polynomial 

On  (a)  =  -1.2889a2  -  0.1588a  -  0.0148  (4.31) 

where  the  Mach  number  is  0.8  and  —0.0349  <  a  <  0.1745. 

Given  the  above  explicit  functional  dependencies  for  the  coefficients  Cose,  Clse  *  and  Cmse, 
by  combining  equations  (5-21)-(5-26),  the  nonlinear  longitudinal  fixed-wing  UAV  model  may  4 
now  be  written  as  follows: 

CFStSt  cos  (a  +  aT)  -  \pV$S  (2.4114a3  +  1.1495a2  +  0.067a  +  0.0179  +  CDSJe) 

—  mg  sin(7) 

Cpst^t  sin(a  +  ay)  +  ^pVpS  (2.6035a  +  0.0948  4-  Cz,ae<5e)  —  mg  cos(7) 

Q  ~  7  (4.32) 

-pVfSc  (  -1.2889 a2  -  0.1588a  -  0.0148  +  ^rC^q  +  CmSeSe 

lly  \  ZVt 

where  the  throttle  position  St  and  the  elevator  angle  Se  are  the  only  two  constraint  inputs, 
namely  0  <  5t  <  1  and  —25°  <  Se  <  25°.  In  addition,  we  assume  that  all  the  states  are 
available  for  measurement: 


mVr  = 

m' yVr  — 
d  = 

Q  = 
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(4.33) 


2/1 

=  VT 

2/2 

=  7 

2/3 

=  a 

2/4 

-  q 

Next,  we  will  define  the  fault  modes  in  the  dynamical  model.  We  assume  that  two  inputs 
St  and  Se  could  both  have  possible  anomalies  which  are  denoted  by  5{  and  S{  in  the  input 
channels.  Also,  it  is  assumed  that  the  UAV  has  two  redundant  inputs,  namely  S\  and  5re,  so 
that  equation  (4.32)  can  be  re-written  as: 


mVT  =  CFSt(St  +  S{  +  5tr)  cos  (a  +  aT) 

~  IpVtS  (2.4114a3  +  1.1495a2  +  0.067a  +  0.0179  +  CD5e(Se  +  S{  +  £))  -  mg sin(7) 
my Vr  =  CFSt(St  +  Sf  +  S[)  sin(a  +  aT) 

+  ^pVfS  (2.6035a  +  0.0948  +  CLSe(Se  +  S{  +  Sre ))  -  mg  cos(7) 
a  —  g  -  7  (4.34) 

q  =  2]-pl4r25c^-1.2889a2  -0.1588a-0.0148  +  ^rCm99  +  Cm5e(5e  +  5e/  +  ^ 

Moreover,  it  is  assumed  that  S{  =  —ktSt  and  6[  =  —ke5e,  where  kt  and  ke  are  piecewise  , 
constant,  0  <  kt,ke  <  1.  When  kt,  ke  =  1,  it  represents  the  scenario  of  complete  fault,  .■ 
whereas  when  kt,ke  —  0,  it  corresponds  to  the  healthy  scenario,  in  which  the  redundant  . 
inputs  5rt  and  Sre  will  be  set  to  zero.  ’ 

Linearization  of  the  longitudinal  fixed-wing  model 


In  this  section,  we  will  perform  linearization  for  the  longitudinal  fixed-wing  model  at  a 
certain  operating  point.  Toward  this  end,  we  need  to  specify  all  the  parameters  in  equa¬ 
tion  (4.34),  which  are  subsequently  used  in  our  numerical  simulations.  The  table  below 
summarizes  these  values: 

4.2.2  Fault  Detection  and  Isolation  for  the  Input  Channel  5e 

In  this  subsection,  we  will  design  an  FDIR  scheme  for  the  input  channel  5e  based  on  the 
nonlinear  fixed-wing  UAV  model  (4.34). 

Application  of  the  Geometric  Approach 

The  purpose  of  applying  a  geometric  approach  [49,  50]  is  to  find  a  new  set  of  states  which 
are  affected  by  the  input  channel  St  and  are  decoupled  from  the  input  channel  Se, 

,  through  which  one  may  design  a  residual  generator  for  the  actuator  fault  S{ . 
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Table  4.7:  to  float  fault  in  the  elevator  input  channel 


Engine  thrust  and  the 
fuselage  reference  line  an¬ 
gle 

oij'  —  0 

Wing  platform  area 

S  =  300 ft2  =  27.8709 m2 

Density  of  air 

p  =  8.9068  x  10~A  slugs /ft*  =  0.4590^/m3(h  =  3000  ft) 

Mean  aerodynamic  chord 

c=  11.32ft  =  3.4503m 

y— body  axis  moment  of 
inertia 

Iy  =  55814slugs  •  ft 2  =  75673 kg  ■  m2 

Aircraft  total  mass 

m  =  205001bs  =  9298.6kg 

Acceleration  due  to  grav¬ 
ity 

g  =  32.2  ft/s2  =  9.80665 m/s2 

Elevator  coefficient  in 
drag 

CD6e  =  -4.0268 

Elevator  coefficient  in  lift 

CLSe  =  -5.8780 

Elevator  coefficient  in 
pitch  moment 

CmSe  =  -0.83232 

Engine  thrust  coefficient 

CF5t  =  234221bs  =  104190N 

Pitch  damping  derivative 

Cmq  —  —32 

In  this  subsection,  let  us  denote  x  =  [  Vt  7  a  q  ]  then  equation  (5-32)  can  be  rewrit¬ 
ten  as 

_I  (2.4114x1  +  1.1495x3  +  O.O6TX3  +  0.0179)  -  gsin(x2) 


Xi 

£3 

x4 

T 

+ 


f  CF5t  cosTx3) 
m 

C F5t  sin(x3) 
mx  1 

CF6t  sin(x3) 
771x1 

0 


1^(2.6035x3  +  0.0948)  -  £  cos(x2) 
x4  -  (2-6035x3  +  0.0948)  +  £  cos(x2) 

2^ px\Sc.  ^—1.2889x3  —  0.1588x3  —  0.0148  +  -^CmqX^j 


(fit  +  fit ) 


+ 


1  pxtS 


Cr 


1  pxiS1 n 
2mLLSe 

1  px\S  /~i 

2  m  _LSe 

fpx\ScC mSe 


L  2Iv 


(4.  +  4.0 


and  the  output  equation  is 

y=[x  1  x2  x3  x4  ] 

If  we  just  consider  the  state  space  equation  for  x4  we  have 


£4  =  —py\Sc  ( -1.2889t/|  -  0.15882/3  -  0.0148  +  -^rCmqx±  )  +  —  pylScCmse{fie  +  fi{) 


2Vt 


2  L 


Therefore  x4  is  only  affected  by  5eand  is  decoupled  from  St  and  we  need  just  to  design  an 
observer  for  x4  in  order  to  detect  faults  in  input  channel^ .  Let  e  =  x4  —  x4  and 
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"  -®4  -  5TyPylSc  (-1.2889 y\  -  0.1588y3  -  0.0148  +  ^Cmqy^  +  ^pyjScCmge(5e)  +  k(x4- 
£4) where  k  >  0.  Then  we  have 

‘  '  e  = -ke  + ^pylScCmsJ* 

■■X  -  ■  r  =  e 

Therefore  if  there  is  no  fault  in  input  channel^,  the  residual  signal  rgoes  to  zero,  but  if  there 
•is  a  fault  in  5e,  the  residual  signal  r  will  be  affected  by  this  fault. 


4.2.3  Fault  Detection  and  Isolation  for  the  Input  Channel  5t 

In  this  subsection,  we  will  apply  the  same  FDIR  scheme  proposed  for  the  input  channel  5e 
to  the  second  input  channel^. 

In  this  case,  the  purpose  of  applying  the  geometric  approach  is  to  find  a  new  set  of  states 
which  are  affected  by  the  signals  from  the  input  channel  5t  and  are  decoupled  from  the  input 
channel  5e,  through  which  one  may  design  a  residual  generator  for  the  actuator  fault  8{ . 

In  this  subsection,  let  us  denote 

r  .  .  ~\T 

U%\  =  ^F6t  cos0 E3+Qt)  CFst  s\n(x3+aT)  cF8t  sin(g3+ar)  q 

'  '  m  tux  1  mx  1 


^pxlScC^.  ]T 

First  we  find  the  conditioned  invariant  distribution  that  containing  P  =  span{p(x )} 
and  involutive.  Since  we  have  full  state  measurement  (h(x)  =  x),  every  distribution  is 
conditioned  invariant  and  therefore 

Next,  by  using  observability  distribution  algorithm,  we  have 


=  o,.a. 


The  necessary  condition  for  solving  the  nonlinear  fundamental  problem  of  residual  generation 
(defined  in  [49])  is: 


(span  {/})x  +  o.c.a.  ^  =  T*X 


which  is  satisfied  since 

( span  {Z})  n  ( span{p })  =  0 

since  P  =  span{p(x)}  is  involutive,  ST2*  can  be  spanned  by  exact  differentials  as  follow: 

Q*  =  span  \  d(^-CmsBxi  +  —CDSex 4),  d(x2  +  x3),  d( logxi  +  x2)  \ 

l  ly  m  L Dde  L L5e  J 

The  dimension  of  the  states  in  new  transformation  that  are  affected  by  l(x)  and  is  decoupled 
from  p(x)  is  the  dimension  of  Cl*,  therefore  in  order  to  find  the  minimum  order  observer  ,  we 
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should  find  the  smallest  fTwhich  satisfied  above  conditions  but  there  is  no  straight  algorithm 
for  finding  this  codistribution. 

In  fixed-wing  model  since  we  have  the  full  state  measurement  every  codistribution  is  an 
observability  codistribution  for  our  model.  Therefore  we  can  consider  the  distribution 

P  =  span  {p{x), pi (x),p2 (x)}  where  px (x)  =[  0  0  1  0  ]Tandp2(x)  =  [  0  0  0  1  ]T 

In  this  case  fl*  =  P1-  and  since  P  =  span{p(x )}  is  involutive,  Q*  can  be  spanned  by 
exact  differentials  as  follow: 

0,*  =  span  j  d(— —  log  xx  +  — x2)  1 

l  <^D5e  LSe  J 

We  have 

D  span  {dh}  =  f2*  =  span  {d  (^i  o  /i)}  =  span  {d  (^i)} 

where  :  R4  — >  R1 

^i(z)  =  7; — logxi  +  7; — x2 

'-'Die  LSe 


0  10  0 
H2=  0  0  10 

0  0  0  1 


*{y)  = 


is  a  diffeomorphism  in  output  space  and 


*1  (y) 
H2y 


$1  (x) 
H2h  (x) 


is  a  diffeomorphism  in  state  space. 

We  can  now  apply  this  diffeomorphism  as  the  coordinate  transformation  z  =  $  (x)  and 
find  the  new  state  space  equation  forz. 

We  have 

**  =  AloSXl  +  ci:X2’ 

z2  =  x2  z3  =  x3  z4  =  x4 


exp (CDSe(z!  -  cT-z2) 


x  =  $_1(z)  = 


ziis  the  only  state  that  we  need  for  fault  detection  in  input  channel  St  and 


*1  =  eXP  (CD6e(z  1  "  chlZ*)) 


S' exp  (cD&e{-zx  +  cts -z2))  (i 
^exp  (cD5e(-Z!  +  ^-z2))  ( 


~2.4114z|  1.1495 z\  Q.Q67z3  ,  0.0179  _  2.6035z3  _  0.0948 

Cole  Cds  Cose  CoSe  Cl6c  CLSc 


sin(z2)  ,  cos(z2)  \  , 

CDSe  Cue  )  ^ 
f  cos(z3+aT)  i  sin(z3+ar)  \  ^ 
V  CD6e  C  LSe  J  t 
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The  output  space  and  state  space  diffeomorphisms  axe  identical  therefore  in  new  coordinates 
we  hmey  =  [  z4  z2  z3  z4  ] .  We  can  rewrite  the  above  equation  as 

*i  =  f(z i,  2/2,  2/3)  +  g(zi,V2,  yz)&t 
The  observer  for  z4  can  be  designed  as 

h  =  f(zu  2/2,  yz)  +  9{z i,  2/2,  yz)8t  +  k(zi  -  z4) 

where  k  >  0. 

4.2.4  Simulation  Results  of  FDI  Scheme  for  the  Longitudinal  Fixed 
Wing  UAV  Model 

In  this  section,  simulation  results  for  our  proposed  nonlinear  FDI  scheme  applied  to  the 
nonlinear  longitudinal  fixed  wing  UAV  model  will  be  presented.  Different  actuator  faults 
have  been  considered  in  elevator  and  throttle  input  channel.  The  initial  conditions  of  the 
simulation  system  are  selected  as: 

Vp  =  282m/ s  ,  70  =  1°  =  0.0175rad  ,  cc0  =  —0.1°  =  — 0.00175rad,  and  q°  =  0  rad/s 

The  model  predictive  controller  has  been  designed  for  stabilizing  the  UAV  and  reference 
trajectory  signals  are  selected  as: 

V r  =  272m/ s  ,  70  =  0°,  ct0  =  —0.1°  =  — 0.00175rad,  and  q°  —  0  rad/s 

Figures  4.2  and  4.3  depict  the  states  of  the  UAV  and  detection  observer  residual  outputs 
when  there  is  no  fault  in  the  system. 

Figures  4.4  and  4.5  depict  the  states  and  residual  outputs  when  there  is  a  float  fault  in 
the  elevator  input  channel  at  t=20sec.  As  it  is  shown  in  these  figures,  the  UAV  is  become 
unstable  in  this  fault  scenario. 

In  order  to  show  the  effectiveness  of  nonlinear  FDI  in  comparison  to  linear  FDI,  a  linear 
detection  filter  was  designed  for  the  linearized  model  of  UAV.  Figure  4.6  shows  the  residual 
outputs  of  linear  detection  observer  when  there  is  a  float  fault  in  the  elevator  channel  and 
in  this  case  linear  observer  cannot  isolate  this  fault  since  both  residuals  have  been  affected 
by  float  fault  in  the  elevator  channel  but  the  nonlinear  detection  filter  perfectly  detects  and 
isolates  this  fault. 

Figures  4.7  and  4.8  depict  the  states  and  residual  outputs  when  there  is  a  Hard  over  fault 
in  the  elevator  input  channel  at  t=20sec.  The  UAV  becomes  unstable  in  less  than  1  second 
after  the  occurrence  of  hard  over  fault. 

Figures  4.9  and  4.10  show  the  states  and  residual  outputs  when  there  is  a  loss  of  effec¬ 
tiveness  fault  (k=0.5)  in  the  elevator  input  channel  at  t=20sec.  The  UAV  remains  stable 
but  it  does  not  converge  to  reference  setpoints. 

Figures  4.11  and  4.12  depict  the  states  and  residual  outputs  when  there  is  a  loss  of 
effectiveness  fault  (k— 0.5)  in  the  elevator  input  channel  at  t=20sec.  The  UAV  remains 
stable  but  it  does  not  converge  to  reference  setpoints. 
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Figures  4.13  and  4.14  depict  the  states  and  residual  outputs  when  there  is  a  loss  of 
effectiveness  fault  (k=0.8)  in  the  elevator  input  channel  at  t=20sec.  The  UAV  remains 
stable  but  it  does  not  converge  to  reference  setpoints. 

Figures  4.15  and  4.16  show  the  states  and  residual  outputs  when  there  is  a  float  fault 
in  throttle  input  channel  at  t=25sec.  Figure  4.17  depicts  the  residual  outputs  of  linear 
observer.  As  it  is  shown  in  this  figure  we  cannot  isolate  the  faults  completely  by  linear 
detection  observer. 

Figures  4.18  and  4.19  show  the  states  and  residual  outputs  when  there  is  a  hard  over 
fault  in  throttle  input  channel  at  t=25sec. 

Figures  4.20  and  4.21  depict  the  states  and  residual  outputs  when  there  is  a  loss  of 
effectiveness  fault  (k=0.2)  in  throttle  input  channel  at  t=25sec. 

Figures  4.22  and  4.23  depict  the  states  and  residual  outputs  when  there  is  a  loss  of 
effectiveness  fault  (k=0.5)  in  throttle  input  channel  at  t=25sec. 

Figures  4.24  and  4.25  depict  the  states  and  residual  outputs  when  there  is  a  loss  of 
effectiveness  fault  (k=0.8)  in  the  throttle  input  channel  at  t=25sec. 

In  all  above  figures,  the  throttle  residual  output  is  completely  affected  by  the  faults  in 
the  throttle  input  channel  and  elevator  residual  output  is  completely  decoupled  from  these 
faults. 

Finally  Figures  4.26  and  4.27  depict  the  states  and  residual  outputs  when  there  are 
simultaneous  faults  in  both  input  channel.  As  it  is  shown  in  figure  4.27  the  residual  outputs 
perfectly  detect  and  isolate  both  faults. 

Based  on  the  5%  disturbance  in  both  input  channels,  we  choose  the  residual  fault  thresh¬ 
old  to  1  x  10-3  for  both  linear  and  nonlinear  elevator  detection  observers  and  1  x  10-4  for 
throttle  detection  observer.  Following  table  summarizes  the  simulation  result  for  both  linear 
and  nonlinear  detection  observers. 

As  it  is  shown  in  the  above  table,  linear  observer  cannot  detect  10%  loss  of  effectiveness 
in  the  elevator  channel  and  it  also  produces  the  false  alarm  in  throttle  residual  when  there 
is  a  float  fault  in  elevator  channel. 
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Table  4.8:  to  a  loss  of  effectiveness  (k=0.8)  in  the  throttle  input  channel 


Nonlinear  observer 


Input  Channel 

Fault  type 

Elevator 

Float 

Elevator 

Loss  of  ef¬ 
fectiveness 
(k=0.9) 

Elevator 

Loss  of  ef¬ 
fectiveness 
(k=0.8) 

Elevator 

Loss  of  ef¬ 
fectiveness 
(k=0.5) 

Throttle 

Float 

Throttle 

Hard  over 

Throttle 

Loss  of  ef¬ 
fectiveness 
(k=0.5) 

Throttle 

Loss  of  ef¬ 
fectiveness 
(k=0.8) 

Throttle 

Loss  of  ef¬ 
fectiveness 
(k=0.9) 

Elevator 

Residual 


Detected 


Throttle 

Residual 


Detected 


Detected 


Detected 


Detected 


Detected 


Linear  Observer 

Elevator 

Residual 

Throttle 

Residual 

Detected 

False 

Alarm 

Not  D 
tected 


Detected 


Detected 


Detected 


Detected 


Detected 


Detected 


Detected 
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Figure  4.6:  Linear  detection  observer  residual  outputs  corresponding  to  float  fault  in  the 
elevator  input  channel 
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Figure  4.7:  States  of  the  UAV  corresponding  to  a  Hard  over  fault  in  the  elevator  input 
channel 
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Figure  4.8:  Detection  observer  residual  outputs  corresponding  to  Hard  over  in  the  elevator 
input  channel 
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Figure  4.9:  States  of  the  UAV  corresponding  to  a  loss  of  effectiveness  (k=0.2)  fault  in  the 
elevator  input  channel 
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Figure  4.14:  Detection  observer  residual  outputs  corresponding  to  a  loss  of  effectiveness 
(k=0.8)  fault  in  the  elevator  input  channel 
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Figure  4.15:  States  of  the  UAV  corresponding  to  a  float  fault  in  throttle  input  channel 
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Figure  4.16:  Nonlinear  detection  observer  residual  outputs  corresponding  to  a  float  fault  in 
throttle  input  channel 
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Figure  4.17:  Linear  detection  observer  residual  outputs  corresponding  to  a  float  fault  in 
throttle  input  channel 
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Figure  4.18:  States  of  the  UAV  corresponding  to  a  Hard  over  fault  in  throttle  input  channel 


x  10 


x  10 


3 

&* 

3 

O 


o 

§ 

w 


t(sec) 


Figure  4.19:  Detection  observer  residual  outputs  corresponding  to  a  Hard  over  fault  in 
throttle  input  channel 
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Figure  4.20:  States  of  the  UAV  corresponding  to  a  loss  of  effectiveness  fault  (k=0.2) 
throttle  input  channel 
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Figure  4.21:  Detection  observer  residual  outputs  corresponding  to  a  loss  of  effectiveness 
(k— 0.2)  in  throttle  input  channel 
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4.3  ALTAV  FDIR 


In  this  chapter,  the  problem  of  actuator  Fault  Detection,  Isolation  and  Recovery  (FDIR) 
for  Lighter-Than-Air  Vehicles  (ALTAV)  is  investigated.  Fisrt,  the  FDI  algorithms  will  be 
design  using  a  nonlinear  geometric  approach.  Due  to  the  particular  dynamics  of  ALTAV, 
six  detection  filters  are  designed  for  FDI  of  the  four  input  channels  of  ALTAV.  Four  of  the 
detection  filters  are  designed  such  that  each  input  channel  affects  only  one  of  the  actuators 
and  the  other  two  detection  filters  are  affected  by  the  corresponding  two  input  channels. 
Using  an  appropriate  combination  of  detection  filters,  one  may  detect  and  isolate  the  faults 
in  all  the  input  channels  associated  with  single  as  well  as  simultaneous  multiple  actuators 
faults.  Numerous  simulation  results  demonstrate  and  show  the  excellent  performance  of  the 
designed  nonlinear  detection  filters. 

Next,  the  safe  mode  operation  of  the  ALTAV  will  be  investigated  to  warranty  the  safety 
of  the  vehicle  after  occurrence  of  the  fault.  In  this  mode,  one  may  just  control  the  altitude  of 
the  vehicle  while  it  is  spinning  around  the  z  axis  and  the  x  and  y  coordinates  of  the  ALTAV 
will  converge  to  the  constant  value.  Finally,  the  fault  diagnosis  algorithm  has  been  proposed 
for  identifying  the  type  of  fault  in  the  safe  mode  operation.  Figure  4.28  shows  the  flowchart 
of  the  FDIR  procedure  for  the  ALTAV  system. 
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Figure  4.28:  Fault  detection,  isolation  and  recovery  flowchart  for  the  ALTAV  system 
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4.3.1  Problem  formulation 

Lighter-Than-Air  Vehicles  (ALTAV)  include  balloons  and  airships.  They  use.  buoyancy  to 
float  in  the  air  in  ways  that  are  similar  to  ships  floating  on  the  water.  The  Quanser  ALTAV 
[?]  provides  a  platform  to  demonstrate  fault  diagnosis  methods  for  fleet  of  unmanned  aerial 
vehicles.  The  Quanser  ALTAV  used  in  the  simulations  in  this  paper  and  in  real  world  ex¬ 
periments,  has  six  degrees  of  freedom  vehicles,  in  which  translational  and  rotational  motions 
are  described  by  six  variables,  and  four  control  inputs  are  available  corresponding  to  four 
motors  on  the  vehicle. 

The  ALTAV  system  used  in  this  paper  and  in  real  world  experiments  is  six  degrees  of 
freedom  unmanned  aerial  vehicle.  The  variables  describing  the  motion  are  x,  y,  z,  9, 7  and  <j>. 
These  variables  correspond  to  the  translation  in  x,  y  and  2  directions  and  rotations  about 
z,y  and  x  axes  (heading,  pitch  and  roll)  ,  respectively,.  It  should  be  noted  that  the  system 
uses  a  ’’right  handed”  coordinate  system  with  the  positive  z  direction  as  down.  The  behavior 
of  the  ALTAV  is  governed  by  the  following  governing  equations: 

Mx  =  Fisini^y)  —  Cxx 

My  =  Fisin(<f>)  -  Cyy 

Mz  —  —  ^2  Ficos{,i)cos{(j))  —  Fb  +  Mg  —  Czz 

Jg9  =  (FJ  —  F2I  +  F3/  —  Fil)sin(p)  —  Cg9 
<  J~ff  =  (Fil  -  F3l)  -  FBLBsin(‘ 7)  -  C7 7 

=  -( F2l  -  F4l)  -  FBLBsin{4>)  -  (4.35) 

where  M  is  the  mass  of  the  vehicle,  J7,  Jg  are  the  moments  of  inertia  about  x,  y  and 
2:  axes,  respectively,  FB  is  the  buoyant  force  resulting  from  the  volume  of  helium  in  the 
vehicle,  Fi,i  =  1,  •  •  ■  ,4  are  the  force  magnitude  of  motors,  l  is  the  perpendicular  distance 
between  the  motors  and  vehicle  center  of  gravity,  C*  is  the  drag  coefficient  in  the  directions 
i  6  [x,  y,  z,  9, 7,  <f>]  which  serves  as  a  damping  term  for  the  motion  in  that  direction,  and  p  is 
the  angular  offset  from  vertical  of  the  motor  thrust  vectors. 

Common  actuator  faults  that  are  considered  in  this  paper  may  include  [?]:  (i)  freezing 
or  lock  in-place  (LIP)  fault,  (ii)  float  fault,  (iii)  hard-over  fault  (HOF),  and  (iv)  loss  of 
effectiveness  (LOE)  fault.  In  the  case  of  LIP  fault,  the  actuator  freezes  at  a  particular 
situation  and  does  not  respond  to  subsequent  commands.  HOF  is  characterized  by  the 
actuator  moving  to  its  upper  or  lower  position  limits  regardless  of  the  commanded  signal. 
The  actuator  speed  of  response  is  bounded  by  the  actuator  rate  limits.  Float  fault  occurs 
when  the  actuator  floats  with  zero  moment  and  does  not  contribute  to  the  control  authority. 
Loss  of  effectiveness  is  characterized  by  lowering  the  actuator  gain  with  respect  to  its  nominal 
value.  Different  types  of  actuator  faults  may  be  mathematically  parameterized  as  follows: 

No  Failure  Case 
0  <  e  <  k(t)  <  1  ,Vt  >  fp(LOE) 

Vt  >  fp(Float)  (4.36) 

Vt  >  tp(LIP) 

Vt  >  fF(HOF) 
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where  tp  denotes  the  time  instant  of  fault  occurrence  in  the  actuator,  k  denotes  its  effective¬ 
ness  coefficient  such  that  k  G  [e,  1]  and  e  denotes  its  minimum  effectiveness,  and  um  and  um 
denote  the  minimum  and  maximum  value  of  the  input  respectively.  The  following  general 
model 

Utrue  ® kucmd  H-  (1  (4.37) 

may  integrate  all  the  above  cases  into  a  single  representation,  where  utrue  is  the  actuator 
output,  Ucmd  is  the  output  of  the  controller  (which  at  the  same  time  is  an  input  to  the 
actuator),  a  =  1  and  k  =  1  in  the  no  fault  operating  regime,  a  =  1  and  e  <  k  <  1  in  the  case 
of  loss  of  effectiveness  fault  and  o  =  0  in  other  types  of  fault  scenarios.  Finally  um  <  u  < 
is  the  position  at  which  the  actuator  locks  in  case  of  float,  lock-in-place  and  hard-over  faults. 
The  objective  of  this  section  is  to  design  the  FDI  scheme  for  the  ALTAV  system  using  the 
nonlinear  geometric  approach. 

4.3.2  Nonlinear  Geometric  FDI  Approach 

In  the  following,  the  method  presented  in  [?]  is  briefly  reviewed.  This  scheme  provides 
us  with  the  necessary  and  sufficient  conditions  for  solving  the  problem  of  detecting  and 
isolating  actuator  faults  for  nonlinear  systems.  It  is  assumed  that  the  nonlinear  system  may 
be  described  by  the  following  nonlinear  model: 

m 

x  =  f(x)  +  g(x)u  +  ^2  9i{x)mi 

i=  1 

y  =  h(x)  (4.38) 

with  state  x  is  defined  in  a  neighborhood  X  of  the  origin  in  Mn  ,  inputs  u  G  Rm  ,  ml  e 
Rm,«  =  1,  •  •  •  ,  m  and  output  y  G  M9  ,  in  which  f(x )  ,  the  m  columns  ^i(x),  •  •  •  ,gm(x )  of 
g(x),  and  h(x)  are  nonlinear  smooth  mappings  and  /( 0)  =  0,  h{ 0)  =  0  .  The  signals  u  and 
m/s  in  (4.38)  denote  the  input  channels  for  control  purposes  and  the  actuator  fault  signals, 
respectively. 

In  nonlinear  geometric  FDI  approach,  one  seeks  at  finding  the  residual  signals  ri(t),i  — 
1,  •  •  •  ,  m  such  that  each  actuator  fault  m*  only  affects  the  corresponding  residual  r*  and  that 
does  not  affect  other  residuals.  Each  residual  signal  can  be  generated  if  one  can  find  the 
largest  observability  codistribution  O*  which  is  locally  spanned  by  exact  differentials  and 
contained  in  P A  and  that  satisfies  the  following  necessary  condition: 

(. span{9i })x  +  fl*  =  T*X  (4.39) 

where  Pi  =  span{gi(x),  •  •  •  ,  ^j_i(x),  gi+ i(x),  •  •  •  ,  gm(x)}.  In  [?]  an  algorithm  is  proposed  for 
finding  such  an  observability  codistribution. 

If  an  observability  codistribution  Q*  exists,  one  may  then  construct  state  and  output 
diffeomorphisms  such  that  the  nonlinear  system  (4.38)  can  be  represented  in  the  following 
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canonical  form  in  the  new  coordinates  (for  details  refer  to  [?]): 

zi  =  fi(zi ,  Z2)  +  gu(zi,  z2)ui  +  gu(zi,  z2)vm 

m  m 

Z2  =  h (zi ,z2,z3)  +  ^2  92] (zi ,  z2 ,  z3)uj  +  ^2  92]  (zi ,  z2 ,  z^rrij 
j= i  j= i 

m  m 

Z3  =  h(zi,z2,z3)  +  ^  g3j (zi ,  z2 ,  z^Uj  +  g3j (zi ,  z2 ,  z3)mj 

j= i  j=i 

l/i  =  ^i(^i) 

l/a  =  22  (4.40) 

Corresponding  to  the  new  state  space  representation,  only  the  fault  signal  m*  can  affect 
the  ^-subsystem,  and  since  z2  can  be  identified  with  output  y2,  one  may  then  interpret 
22 as  an  auxiliary  and  independent  input  to  the  ^-subsystem.  Due  to  the  main  property  of 
the  unobservability  codistribution,  the  21 -subsystem  satisfies  observability  rank  conditions 
and  one  can  therefore  design  an  asymptotic  observer  for  the  state  z\.  Hence,  the  problem 
of  detecting  and  isolating  faults  in  the  original  nonlinear  system  (4.38)  reduces  to  that  of 
designing  an  observer  for  the  observable  ^-subsystem. 

4.3.3  FDI  design  for  the  ALTAV  system 

In  this  section,  FDI  residual  generators  are  designed  for  the  four  input  channels  of  the  ALTAV 
system.  The  state  space  equations  of  the  ALTAV  system  may  be  rewritten  as  follows: 

X  =  f(X)  +  gi(X)Fi  +  g2(X)F2  +  g3(X)F3  +  g±{X)Fi 
Y  =  X+-v  (4.41) 
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where  XT  —{xyzxyzO^(f)dAf(j)\  and  v  is  the  measurement  noise  and 


9i(X)  = 


93(X)  = 


0 

0' 

0 

0 

0 

0 

jjsin{X8 ) 
jjsin(X g) 
-jjCos(X8)cos(Xg) 

0 

92(X)  = 

jjSin{X8) 

Xsin(Xg) 

~’MCOS(X8)cOs(Xg) 

0 

0 

0 

0 

0 

j-gsm(p) 

0 

- Tesin(P ) 

0 

l 

L  j* 

0 

0 

0 

0 

0 

0 

jjsin(X8 ) 
Xsin(X9) 
-■^cos(X8)cos(Xg) 

0 

94(X)  = 

-tfSin(X8) 

Xsin(Xg) 

~JjCOs{X8)cOs{Xg) 

0 

0 

0 

0 

0 

1 - 

o  !  * 

i _ 

-d-sm(p) 

0 

l 

J*  J 

For  detecting  a  fault  in  the  input  channel  Pi,  one  should  determine  a  new  set  of  states 
that  axe  affected  by  F1  and  decoupled  from  other  channels  P2,  P3  and  P4.  Towards  this  end, 
the  largest  unobservability  codistribution  Oi  which  is  contained  in  Pj1  should  be  found  where 
Pi  =  span{g2(X),  g3(X),  gA(X)}  and  also  the  following  condition  should  hold: 

spanlg^X)}  <£  (4.42) 

Condition  (4.42  is  the  necessary  condition  for  decoupling  the  faults  in  nonlinear  systems.  In 
the  ALTAV  model;  since  full  state  measurements  are  available,  then 


=  Pxx  (4.43) 

According  to  the  above  unobservability  distribution,  the  following  state  may  be  found  which 
is  affected  by  Pi  and  decoupled  from  other  input  channels. 

z\  =  2  J7sin(p)sin(X&)Xn  +  Jgsin(X8)Xio  +  lMsin(p)X 4 

Repeating  the  same  approach,  one  may  find  the  following  set  of  states  such  that  for  each 
i  =  2,  3, 4,  Zi  is  affected  by  Pj  and  decoupled  from  other  input  channels,  namely 

z2  =  —  2  Jtj>sin(p)sin(Xs)X12  —  Jesin(X8)Xw  +  /Msm(p)A4 
z3  =  —2J1sin(p)sin(X8)Xn  -f  Jesin(X8)Xw  +  lMsin(p)Xli 
z4  =  2J<t,sin(p)sin(X8)X12  —  Jesin(X8)X1Q  +  lMsin(p)X4: 
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The  state  space  representation  of  the  above  states  may  be  expressed  as  follows: 

i  i  =  —  2CjSin(p)sin(X8)Xn  —  2FBLBsin(p)sin2(X8) 

+  2  J~fcos(X8)sin(p)X2l  —  CgX4osin(X8) 

+  JoX\qX\\cos{X%)  —  CxX4lsin(p) 

+  4  lsin(p)sin(X8)Fi 

z2  =2C<j)sin(p)sin(Xs)Xi2  +  2  FBLBsin(p)sin(X8)sin(Xg) 

—  2J^,cos(X8)sm(p)XnXi2  +  CeXiosin(Xs) 

—  JeX10Xncos(X8 )  -  CxX4lsin(p ) 

+  4lsin(p)sin(X8)F2 

z3  —2C7sin(p)sin(X8)Xn  +  2  FBLBsin(p)sin2(X8)] 

—  2  J1cos(X8)sin(p)Xf1  —  CgXi0sin(X8) 

+  JeXwXncos(X8)  —  CxX4lsin(p) 

+  4:lsin(p)sin(X8)F8 

z4  =  —  2  C<j}sin(p)sin(X8)  X12  —  2FBLBsin(p)sin(X8)sin(Xg) 

+  2  J<j)cos(X8)sin(p)XiiXi2  +  C$Xiosin(X8 ) 

—  JeX10Xncos(X8)  —  CxX4lsin(p) 

+  Alsin(p)sin(X8)F4 

In  the  above  state  equations  for  Zi,  i  =  1,  •  •  •  ,4  the  input  signal  Fi,  i  —  1,  •  •  •  ,  4  is  multiplied 
by  the  term  sin(X8 )  (sm(7)).  This  will  introduce  a  problem  in  the  fault  detection  decision 
making  process.  When  there  is  a  fault  in  one  of  the  input  channels  and  7  oscillates  around 
zero,  the  corresponding  residual  will  also  oscillate  about  zero.  Thus,  one  may  not  be  able 
to  explicitly  determine  the  presence  of  a  fault.  To  remedy  this  problem,  two  other  states 
are  introduced  and  considered  for  the  purpose  of  unambiguous  fault  detection  and  isolation 
strategy  as  follows: 

Z5  =  Xu 

z8  =  X12  (4.44) 

where  the  state  space  representation  corresponding  to  these  two  states  are  given  by: 

(4.45) 

(4.46) 

As  seen  in  the  above  equations,  25  is  affected  by  two  input  channels  F\  and  F8  and  is 
decoupled  from  the  other  two  channels.  Furthermore  state  z8  is  complementary  to  z$  i.e., 
it  is  affected  by  input  channels  F2  and  F4  and  is  decoupled  from  other  channels.  Moreover, 
the  coefficients  of  these  input  channels  are  constant  and  are  not  affected  by  the  states  of 
the  ALTAV  system.  Consequently,  the  corresponding  residuals  do  not  show  any  oscillation 
around  zero  due  to  the  particular  behavior  of  the  states  of  the  ALTAV  system. 


2:5  =  ~y-z5  -  Fb^b  sin(X8)  +  -!j-(Fi-  F3) 

t/'y  i/'y  c/-«y 

z6  =  -^ze  -  FbFb sin(X9)  +  ^-(F4  -  F2) 


79 


Our  proposed  detection  filters  or  nonlinear  observers  may  now  be  designed  for  the  above 
states.  Since  in  the  ALTAV  system,  all  states  are  measurable,  the  following  observers  can 
be  designed  for  the  above  states,  namely 

zi  =  —  2C7sin(p)sin(Ys)Yn  —  2FBLBsin(p)sin2(Y8) 

+  2J1cos(Y8)sin{p)Y2l  -  CgYwsin(Y8 ) 

+  JeYwYncos{Y8)  -  CxYAlsin(p) 

+  Alsin(p)sin(Y8)Fi  —  k(z\  —  £\) 
z2  =2C<j)sin(p)sin(Y8)Yi2  +  2  FBLBsin(p)sin(Y8)sin(Yg) 

-  2Jlj>cos(Y8)sin(p)YnYi2  +  CgY1Qsin(Y8) 

-  J0YwYucos(Y8)  -  CxYAlsin(p ) 

+  4:lsin(p)sin(Y8)F2  -  k(z2  -  z2) 

z3  —2C1sin(p)sin(Y8)Yn  +  2FBLBsin(p)sin2(Y8)\ 

-  2J17cos(Y8)sin(p)Y21  —  CgYi0sin(Y8 ) 

+  ^0^io^ncos(>8)  -  CxYAlsin(p) 

+  4lsin(p)sin(Y8)F3  -  k(z3  -  z3 ) 

£4  =  —  2Clpsin(p)sin(Y8)Y12  —  2FBLBsin(p)sin(y8)sin(Y$) 

+  2J<j>cos(Y8)sin(p)YnY12  +  CgYwsin(Y8) 

-  JeY10Yncos(Y8)  -  CxYAlsin{p) 

+  Alsin{p)sin(Y8)F4  —  k(zA  —  £4) 

4  =  ~^z5  -  sin(Y8 )  +  -j-(Fi  -  F3)  -  k(z5  -  £5 ) 

tj  ^  tJ  ry 

4  =  ~^z6  -  sin(Y9 )  +  -j-(F4  -  F2)  -  k(z6  -  £*) 

J (j)  J (f)  J  <f) 

where  k  >  0.  Corresponding  to  above  observers,  the  following  residuals  may  then  be  gener¬ 
ated. 


n  =  zt  —  h 
r2  =  z2-  £2 
r3  =  z3-  £3 

rA  =  zA  —  £4 
^13  =  *13  -  Z13 
r24  =  Z24  -  £ 24 


For  each  residual  7-j,  one  can  define  the  flag  Ri  such  that  whenever  the  corresponding  residual 
exceeds  its  threshold,  it  will  be  set  to  1  and  when  the  residual  is  less  than  the  threshold, 
it  will  be  set  to  0  and  the  initial  value  of  all  flags  is  0.  Then  one  can  define  the  following 
detection  flags  flagi,  flag2,  flag3,  flag4,  flagA3 ,  flag2 4  that  can  be  used  to  detect  and  isolate 
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the  faults  in  the  input  channels. 


flagi  =  #1  V  (#13  A  flagi) 
flag2  =  #2  V  (#24  A  flag2 ) 
/Zas3  =  #3  V  (#i3  A  /Zap3) 
flag  a  =  #4  V  (#24  A  flagf) 
flagiz  =  #13 
flag24  =  #24 


Remark :  According  to  the  above  detection  flags,  one  can  detect  and  isolate  all  faults  in  the 
vehicle  except  the  scenarios  that  there  are  simultaneous  faults  in  the  input  channels  #i  and 
#3  such  that  one  of  the  faults  are  intermittent.  In  this  case  both  detection  flags  flagi  and 
flags  remain  1.  However  this  problem  can  be  avoided  by  going  to  safe  mode  operation  after 
detection  of  the  fault  and  diagnosis  the  each  input  channel  separately.  The  same  problem 
can  happen  for  the  input  channels  #2  and  #4. 
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Figure  4.29:  The  desired  reference  trajectories  (dashed  line)  and  the  actual  ALTAV  trajec¬ 
tories  (solid  line)  in  the  healthy  operation 

4.3.4  Simulation  Results 

In  this  section,  simulation  results  of  our  proposed  nonlinear  FDI  scheme  when  applied  to 
the  nonlinear  ALTAV  model  will  be  presented.  Different  actuator  faults  are  considered  in 
all  the  respective  four  input  channels.  We  have  considered  two  sources  of  disturbance  on  the 
ALTAV  system  as  follows: 

(i)  Measurement  noise  v:  Uniform  random  noise 

(ii)  Wind  disturbance  on  x-axis:  0.12  N  disturbance  force  on  x  direction 

Figure  4.29  shows  the  desired  reference  trajectory  and  the  actual  ALTAV  trajectory  in  the 
normal  or  healthy  operation  of  the  ALTAV.  In  this  surveillance  maneuver,  the  ALTAV  first 
starts  it  motion  from  point  (0,0,5)  *  follows  the  square  path  in  the  x-y  plane,  changes  its 
altitude  to  10  and  follows  the  same  square  in  this  altitude. 

Figure  4.30  depicts  the  residuals  of  6  observers  when  there  is  no  fault  in  the  ALTAV 
system.  By  considering  the  maximum  value  of  residuals  in  the  normal  mode  and  some  safety 
factor,  the  threshold  value  of  0.03  and  0.008  were  considered  for  the  residuals  rq,  r2,  r3,  r± 
and  rx3,r24  respectively. 
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Figure  4.30:  Residuals  corresponding  to  healthy  operation  (No  Fault) 


The  errors  between  the  reference  trajectory  and  the  actual  trajectory  in  each  direction 
are  considered  to  quantify  the  effect  of  fault  on  the  vehicle  motion.  They  are  defined  as 


(4.47) 

where  {x,  y,  z}ref  denote  the  reference  trajectories  of  x,  y  and  z  directions,  respectively. 
For  the  cases  that  the  motion  of  the  vehicle  become  unstable  in  specific  direction,  100%  is 
assigned  to  the  corresponding  error. 

4.3.5  Single  Fault  scenarios 

Figures  4.31,  4.32  and  4.33  show  the  residuals,  the  detection  flags  and  the  ALTAV  states 
correspond  to  a  float  fault  in  iq  actuator  at  t  =  100  seconds,  respectively.  As  it  is  shown 
in  figure  4.31,  the  residuals  rq  and  773  exceed  their  thresholds  but  after  about  30  seconds 
the  residual  rq  starts  to  oscillate  around  zero  due  to  oscillations  present  in  7.  However  by 
considering  the  residual  7-13  which  remains  above  its  threshold  we  may  conclude  that  the 
fault  still  exists  in  the  input  channel  F\.  According  to  4.32  one  can  detect  and  isolate  the 
float  fault  in  F\.  Figure  4.34  show  the  actual  trajectory  of  the  ALTAV.  Figures  4.35  and  4.36 
depict  the  residuals  and  the  detection  flags  correspond  to  a  hard  over  fault  in  F\  actuator  at 
t  =  100  seconds,  respectively.  In  this  faulty  scenario,  there  is  no  oscillation  in  the  residual  rq 


e.  =  x  100 

xref 

=  yref^ -_y  x  100 

xref 
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Figure  4.31:  Residuals  corresponding  to  a  float  fault  in  F\  actuator 

and  one  can  easily  detect  and  isolate  this  fault  in  F\  actuator.  Figure  4.37  show  also  that  a 
hard  over  fault  has  a  severe  impact  on  the  states  of  the  ALTAV.  Figures  4.38  and  4.39  depict 
the  residuals  and  the  detection  flags  correspond  to  a  lock  in  place  fault  in  F\  actuator  at 
t  =  100  seconds,  respectively.  According  to  these  figures,  one  can  just  detect  but  not  isolate 
the  fault  in  the  input  channels  F\  and  F3.  Figure  4.40  show  that  this  fault  has  a  severe 
effect  on  the  states  of  the  ALTAV  too.  Figures  4.41  and  4.42  show  the  residuals  and  the 
detection  flags  correspond  to  a  20%  loss  of  effectiveness  in  F\  actuator  at  t  =  100  seconds, 
respectively.  According  to  these  figures  one  can  only  detect  the  occurrence  of  the  fault  in  one 
of  the  input  channels  Fi  and  F3  but  cannot  isolate  between  these  two.  Figures  4.44,  4.45  and 
4.46  show  the  residuals,  the  detection  flags  and  the  ALTAV  states  correspond  to  a  50%  loss 
of  effectiveness  in  Fi  actuator  at  t  =  100  seconds,  respectively.  These  figures  demonstrate 
that  one  can  only  detect  the  occurrence  of  the  fault  in  one  of  the  input  channels  F\  and  F3 
but  cannot  isolate  between  these  two.  Figures  4.47,  4.48  and  4.49  show  the  residuals,  the 
detection  flags  and  the  ALTAV  states  correspond  to  a  80%  loss  of  effectiveness  in  F\  actuator 
at  t  —  100  seconds,  respectively.  These  figures  demonstrate  that  one  can  only  detect  the 
occurrence  of  the  fault  in  one  of  the  input  channels  F\  and  F3  but  cannot  isolate  between 
these  two. 
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Type  of  fault 

Detection 

Isolation 

Float 

/ 

/ 

Hard  over 

/ 

/ 

Lock  in  place 

/ 

- 

20%  Loss  of  effectiveness 

/ 

- 

50%  Loss  of  effectiveness 

/ 

- 

80%  Loss  of  effectiveness 

/ 

/ 

Table  4.9:  Fault  detection  and  isolation  results  for  F\  actuator 
Table  4.9  summarizes  the  detection  and  isolation  results  for  F\  actuator. 
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Figure  4.50:  Residuals  corresponding  to  a  float  fault  in  F2  actuator 

Figures  4.50,  4.51  and  4.33  show  the  residuals,  the  detection  flags  and  the  ALTAV  states 
correspond  to  a  float  fault  in  F2  actuator  at  t  =  100  seconds,  respectively.  As  it  is  shown 
in  figure  4.50,  the  residuals  r2  and  r2 4  exceed  their  thresholds  but  after  about  30  seconds 
the  residual  r2  starts  to  oscillate  around  zero  due  to  oscillations  present  in  7.  However  by 
considering  the  residual  r2 4  which  remains  above  its  threshold  we  may  conclude  that  the 
fault  still  exists  in  the  input  channel  F2.  According  to  4.51  one  can  detect  and  isolate  the 
float  fault  in  F2.  Figures  4.53,  4.54  and  4.55  depict  the  residuals  and  the  detection  flags 
correspond  to  a  hard  over  fault  in  F2  actuator  at  t  =  100  seconds,  respectively.  In  this  faulty 
scenario  too,  although  there  are  some  oscillations  around  zero  in  the  residual  r2,  one  can  still 
detect  and  isolate  this  fault  in  F2  actuator.  Figures  4.56,  4.57  and  4.58  depict  the  residuals, 
the  detection  flags  and  the  ALTAV  states  correspond  to  a  lock  in  place  fault  in  F2  actuator  at 
t  —  100  seconds,  respectively.  According  to  these  figures,  one  can  just  detect  but  not  isolate 
the  fault  in  the  input  channels  F2  and  F4.  Figures  4.59,  4.60  and  4.61  show  the  residuals, 
the  detection  flags  and  the  ALTAV  states  correspond  to  a  20%  loss  of  effectiveness  in  F2 
actuator  at  t  =  100  seconds,  respectively.  According  to  these  figures,  one  can  just  detect  but 
not  isolate  the  fault  in  the  input  channels  F2  and  F4.  Figures  4.62,  4.63  and  4.64  show  the 
residuals,  the  detection  flags  and  the  ALTAV  states  correspond  to  a  50%  loss  of  effectiveness 
in  F2  actuator  at  t  =  100  seconds,  respectively.  These  figures  demonstrate  that  one  can  only 
detect  the  occurrence  of  the  fault  in  one  of  the  input  channels  F2  and  F4  but  cannot  isolate 
between  these  two.  Figure  4.64  shows  the  states  of  the  ALTAV  which  demonstrates  how  this 
fault  affect  the  ALTAV  states.  Figures  4.65,  4.66  and  4.67  show  the  residuals,  the  detection 
flags  and  ALTAV  states  correspond  to  a  80%  loss  of  effectiveness  in  F2  actuator  at  t  =  100 
seconds,  respectively.  These  figures  demonstrate  that  one  can  only  detect  the  occurrence  of 
the  fault  in  one  of  the  input  channels  F2  and  F4  but  cannot  isolate  between  these  two. 


Type  of  fault 

Detection 

Isolation 

Float 

/ 

/ 

Hard  over 

/ 

/ 

Lock  in  place 

/ 

- 

20%  Loss  of  effectiveness 

/ 

- 

50%  Loss  of  effectiveness 

/ 

- 

80%  Loss  of  effectiveness 

/ 

- 

Table  4.10:  Fault  detection  and  isolation  results  for  F2  actuator 

Table  4.10  summarized  the  detection  and  isolation  results  for  F2  actuator  and  table  ?? 
shows  the  effect  of  fault  on  tracking  of  reference  trajectories. 


Type  of  fault 

Detection 

Isolation 

Float 

/ 

/ 

Hard  over 

/ 

/ 

Lock  in  place 

/ 

- 

20%  Loss  of  effectiveness 

/ 

- 

50%  Loss  of  effectiveness 

/ 

- 

80%  Loss  of  effectiveness 

/ 

- 

Table  4.11:  Fault  detection  and  isolation  results  for  F3  actuator 

Figures  4.68,  4.69  and  4.68  show  the  residuals,  the  detection  flags  and  the  ALTAV  states 
correspond  to  a  float  fault  in  F3  actuator  at  t  =  100  seconds,  respectively.  As  it  is  shown 
in  figure  4.68,  the  residuals  rx  and  r13  exceed  their  thresholds  but  after  about  30  seconds 
the  residual  rx  starts  to  oscillate  around  zero  due  to  oscillations  present  in  7.  However  by 
considering  the  residual  r  13  which  remains  above  its  threshold  we  may  conclude  that  the 
fault  still  exists  in  the  input  channel  F3.  According  to  4.69  one  can  detect  and  isolate  the 
float  fault  in  F3.  Figures  4.71,  4.72  and  4.73  depict  the  residuals,  the  detection  flags  and  the 
ALTAV  states  correspond  to  a  hard  over  fault  in  F$  actuator  at  t  =  100  seconds,  respectively. 
In  this  faulty  scenario,  there  is  no  oscillation  in  the  residual  rx  and  one  can  easily  detect 
and  isolate  this  fault  in  F3  actuator.  Figures  4.74,  4.75  and  4.76  depict  the  residuals,  the 
detection  flags  and  the  ALTAV  states  correspond  to  a  lock  in  place  fault  in  F3  actuator  at 
t  =  100  seconds,  respectively.  According  to  these  figures,  one  can  just  detect  but  not  isolate 
the  fault  in  the  input  channels  Fx  and  F3.  Figures  4.77,  4.78  and  4.79  show  the  residuals 
and  the  detection  flags  correspond  to  a  20%  loss  of  effectiveness  in  jF3  actuator  at  t  =  100 
seconds,  respectively.  According  to  these  figures  one  can  only  detect  the  occurrence  of  the 
fault  in  the  input  channels  Fx  and  F3.  Figures  4.80,  4.81  and  4.82  show  the  residuals  , 
the  detection  flags  and  the  ALTAV  states  correspond  to  a  50%  loss  of  effectiveness  in  F3 
actuator  at  t  =  100  seconds,  respectively.  These  figures  demonstrate  that  one  can  only 
detect  the  occurrence  of  the  fault  in  one  of  the  input  channels  Fx  and  F3  but  cannot  isolate 
between  these  two.  Figures  4.83,  4.84  and  4.85  show  the  residuals,  the  detection  flags  and 
ALTAV  states. .correspond,  to.  a  80%  loss  of  effectiveness  in  F3  actuator  at  t  =  100  seconds, 
respectively.  These  figures  demonstrate  that  one  can  only  detect  the  occurrence  of  the  fault 
in  one  of  the  input  channels  Fx  and  F3  but  cannot  isolate  between  these  two. 
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Figure  4.70:  ALTAV  states  corresponding  to  a  float  fault  in  F3  actuator 
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Figure  4.71:  Residuals  corresponding  to  a  hard  over  fault  in  F3  actuator 
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Figure  4.82:  ALTAV  states  corresponding  to  a  50%  loss  of  effectiveness  fault  in  F3  actuator 
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Type  of  fault 

Detection 

Isolation 

Float 

/ 

/ 

Hard  over 

/ 

/ 

Lock  in  place 

/ 

- 

20%  Loss  of  effectiveness 

- 

- 

50%  Loss  of  effectiveness 

/ 

- 

80%  Loss  of  effectiveness 

/ 

- 

Table  4.12:  Fault  detection  and  isolation  results  for  F4  actuator 

Figures  4.87,  4.88  and  4.86  show  the  residuals,  the  detection  flags  and  ALTAV  state 
correspond  to  a  float  fault  in  F4  actuator  at  t  =  100  seconds,  respectively.  As  it  is  shown 
in  figure  4.87,  the  residuals  r2  and  r24  exceed  their  thresholds  but  after  about  30  seconds 
the  residual  r2  starts  to  oscillate  around  zero  due  to  oscillations  present  in  7.  However  by 
considering  the  residual  r2 4  which  remains  above  its  threshold  we  may  conclude  that  the 
fault  still  exists  in  the  input  channel  F4.  According  to  4.88  one  can  detect  and  isolate  the 
float  fault  in  F4.  Figures  4.90,  4.91  and  4.89  depict  the  residuals  and  the  detection  flags 
correspond  to  a  hard  over  fault  in  F4  actuator  at  t  =  100  seconds,  respectively.  In  this 
faulty  scenario  too,  although  there  are  some  oscillations  around  zero  in  the  residual  r2,  one 
can  still  detect  and  isolate  this  fault  in  F4  actuator.  Figures  4.93,  4.94  and  4.92  depict  the 
residuals,  the  detection  flags  and  ALTAV  states  correspond  to  a  lock  in  place  fault  in  F4 
actuator  at  t  =  100  seconds,  respectively.  According  to  these  figures,  one  can  just  detect  but 
not  isolate  the  fault  in  the  input  channels  F2  and  F4.  Figures  4.96,  4.97  and  4.95  show  the 
residuals,  the  detection  flags  and  the  ALTAV  states  correspond  to  a  20%  loss  of  effectiveness 
in  F4  actuator  at  t  =  100  seconds,  respectively.  According  to  these  figures  one  can  only 
detect  the  occurrence  of  the  fault  in  one  of  the  input  channels  F2  and  F4  but  cannot  isolate 
between  these  two.  Figures  4.99,  4.100  and  4.98  show  the  residuals,  the  detection  flags  and 

the  ALTAV  states  correspond  to  a  50%  loss  of  effectiveness  in  Fa  actuator  at  t  =  100  seconds. _ 

respectively.  These  figures  demonstrate  that  one  can  only  detect  the  occurrence  of  the  fault  ' 
in  one  of  the  input  channels  F2  and  F4  but  cannot  isolate  between  these  two.  Figures  4.102 
,  4.103  and  4.101  show  the  residuals  ,  the  detection  flags  and  ATLAV  states  correspond 
to  a  80%  loss  of  effectiveness  in  F4  actuator  at  t  —  100  seconds,  respectively.  These  figures 
demonstrate  that  one  can  only  detect  the  occurrence  of  the  fault  in  one  of  the  input  channels 
F2  and  F4  but  cannot  isolate  between  these  two. 
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.4.3.6  Multiple  Concurrent  Faults  Scenarios 

In  this  section,  the  multiple  concurrent  fault  scenarios  will  be  considered  and  simulation 
results  show  the  effectiveness  of  the  proposed  FDI  method  for  detection  and  isolation  of  the 
concurrent  faults.  Figures  4.104,  4.105  and  4.106  show  the  residuals,  the  detection  flags  and 
the  ALTAV  states  correspond  to  a  intermittent  float  fault  in  F\  actuator  at  100  <  t  <  150 
seconds  and  the  float  fault  in  F2  actuator  at  t  >  120  seconds,  respectively.  As  it  is  shown 
in  these  figures  one  can  detect  and  isolate  both  faults  in  the  input  channels  F\  and  F2. 
Figures  4.107,  4.108  and  4.109  show  the  residuals,  the  detection  flags  and  the  ALTAV  states 
correspond  to  a  intermittent  float  fault  in  F\  actuator  at  100  <  t  <  150  seconds  and  the 
float  fault  in  F3  actuator  at  t  >  120  seconds,  respectively.  According  to  these  figures,  one 
can  detect  the  occurrence  of  the  float  fault  in  Fi  actuators  right  after  the  occurrence  of  the 
fault  (t  =  100)  but  when  the  second  fault  happens  in  F3  actuator,  the  residuals  rl5  r3  and  ri3 
become  zero  after  some  transient  and  the  detection  flags  does  not  shows  the  existence  of  these 
concurrent  faults  in  the  system  until  the  time  that  the  float  fault  in  Fi  will  be  disappeared. 
Then  the  detection  flags  show  the  fault  in  F3.  This  happens  since  in  this  scenario  float  fault 
has  happened  in  both  F\  and  F3  actuators  (Fi  =  0,  F3  —  0)  and  the  controller  command  in 
this  situation  assigns  the  same  value  for  both  Fi  and  F3  input  command  which  means  that 
F\  —  F3  ='0.  Therefore  the  residual  ri3  is  not  affected  in  the  scenario  Since  this  residuals  is 
only  affected  by  the  difference  between  Fi  and  F3. 

Figures  4.110,  4.111  and  4.112  show  the  residuals,  the  detection  flags  and  the  ALTAV 
states  correspond  to  a  intermittent  float  fault  in  Fi  actuator  at  100  <  t  <  150  seconds  and 
the  hard  over  fault  in  F3  actuator  at  t  =  120  seconds,  respectively.  These  figures  shows  that 
in  this  scenario  one  can  detect  and  isolate  both  faults  in  Fi  and  F3  actuators.  However, 
as  it  is  mention  before  detection  flags  cannot  detect  the  removal  of  the  float  fault  from  Fi 
actuator  .  Figures  4.113,  4.114  and  4.115  show  the  residuals,  the  detection  flags  and  the 
ALTAV  states  correspond  to  a  intermittent  float  fault  in  Fi  actuator  at  100  <  t  <  150 
seconds  and  a  50%  loss  of  effectiveness  in  Fi  actuator  at  t  =  120  seconds,  respectively.  In 
this  scenario  fault  detection  and  isolation  can  be  done  perfectly  by  using  the  detection  flags. 
Figures  4.116,  4.117  and  4.118  show  the  residuals,  the  detection  flags  and  the  ALTAV  states 
correspond  to  a  intermittent  float  fault  in  F2  actuator  at  100  <  t  <  150  seconds  and  a  float 
fault  in  F4  actuator  at  t  =  120  seconds,  respectively.  The  same  problem  will  happen  also 
here  (like  the  Fi,F3  concurrent  float  faults)  and  the  detection  flags  does  not  detect  the  fault 
in  the  time  interval  120  <  t  <  150  since  the  residual  r2±  is  also  affected  only  by  the  difference 
F2  —  F4.  Finally,  Figures  4.116,  4.117  and  4.118  show  the  residuals,  the  detection  flags  and 
the  ALTAV  states  correspond  to  a  intermittent  float  fault  in  F2  actuator  at  100  <  t  <  150 
seconds  and  a  hard  over  fault  in  F4  actuator  at  t  =  120  seconds,  respectively.  These  figures 
shows  that  in  this  scenario  one  can  detect  and  isolate  both  faults  in  F2  and  F43  actuators. 
However,  as  it  is  mention  before  detection  flags  cannot  detect  the  removal  of  the  float  fault 
from  F2  actuator  . 
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Figure  4.113:  Residuals  corresponding  to  concurrent  faults  in  Fi  and  F4  actuators  (Fi:  Float 
,  F4:  50%  Loss  of  effectiveness) 
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Figure  4.114:  Detection  flags  corresponding  to  concurrent  faults  in  Ft  and  F4  actuators  (F^ 
Float  ,  F4:  50%  Loss  of  effectiveness) 
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Figure  4.119:  Residuals  corresponding  to  concurrent  faults  in  F2  and  F4  actuators  (F2:  Float 
,  F4:  Hard  over) 


a  o 

-l 


o 


a 


l 

o 

-l 

l 

0 

-1 


50 


50 


50 


100 

t 


100 

t 


150 


200 


100 

t 


150  200 


50 


150 


200 


100 

t 


i 

a  o 

-l 

150  200 


200 


Figure  4.120:  Detection  flags  corresponding  to  concurrent  faults  in  F2  and  FA  actuators  (F2: 
Float  ,  F4:  Hard  over) 
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Figure  4.121:  ALTAV  states  corresponding  to  concurrent  faults  in 
Float  ,  F4:  Hard  over) 
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4.3.7  Safe  mode  operation  for  ALTAV 

In  this  section,  fault  recovery  system  will  be  investigated  for  the  ALTAV  system.  A  fault 
tolerant  control  systems  needs  to  recover  from  the  faults  after  the  fault  detection  and  isolation 
(FDI).  In  the  previous  section,  the  required  detection  filters  for  FDI  was  proposed.  However, 
for  fault  recovery  one  should  identify  the  type  of  fault  too.  In  order  to  warranty  the  safety 
of  the  vehicle  motion  during  the  fault  diagnosis  procedure,  one  should  switch  the  controller 
to  a  safe  mode  operation.  According  to  the  dynamics  of  ALTAV,  the  input  channels  may  be 
divided  into  two  pairs,  1)  fq ,  F3 ,  2)  F2,  F4.  First  we  consider  that  the  fault  has  been  detected 
in  one  of  the  input  channels  of  the  first  pair.  In  this  case,  we  should  turn  off  both  actuators 
Fi  and  F3  and  apply  the  same  command  for  the  input  channels  F2  and  F4  (F  —  F2  =  F4). 
The  equation  of  ALTAV  motion  in  this  scenario  can  be  written  as  follows: 


Mx  =  2Fsin(ry)  —  Cxx 

My  =  2  Fsin(4>)  —  Cyy 

Mz  —  —2Fcos(y)cos(4>)  ~  Fb  +  Mg  —  Czz 

Jed  =  —2  Fsin(p)  —  CgO 

A7  =  -FBLBsin( 7)  -  C7 7 

J<t><f>  =  -FBLBsin{4>)  -  Q.0  (4.48) 

We  can  rewrite  the  dynamics  of  7  in  this  condition  as 

C  F  L 

7  +  -yi  +  Bt  B  sin^)  =  0  (4.49) 

U  • y 

and  by  using  Lyapunov  stability  theory  we  can  prove  that  the  origin  7  =  0  is  asymptotically 
stable  for  all  initial  value  70  <  n.  The  same  also  holds  for  the  0  dynamics.  Therefore  both 
7  and  0  converge  to  zero.  The  equation  of  the  translational  dynamics  of  the  ALTAV  can  be 
written  as  follows  for  7  =  0  and  0  =  0: 

Mx  =  -Cx±  (4.50) 

My  =  —Cyy  (4.51) 

Mz  =  -2  F  —  Fb  +  Mg  —  Czz  (4.52) 

According  to  the  equation  4.50,  the  motion  in  x  direction  is  stable  and  x  converges  to  a  fixed 
value  and  x  converges  to  zero.  The  same  also  holds  for  the  y  direction.  In  the  other  words, 
the  (x,y)  position  of  the  ALTAV  converges  to  the  fixed  point  in  the  (x,y)  plane.  We  can  use 
the  existing  freedom  in  the  remaining  input  channels  {F2  =  F4  =  F)  to  control  the  altitude 
of  the  vehicle  by  designing  the  controller  for  the  z  dynamics  4.52.  The  heading  dynamics  9 
for  the  fixed  controller  input  F  (fixed  set  point  for  altitude)is  governed  by  following  equation 

Je9  =  -2 Fsin(p)  -  C80  (4.53) 

which  has  the  solution  9  =  at  and  9  —  a  for  some  fixed  value  a  >  0.  This  means  that  the 

vehicle  rotates  around  the  z  axis  in  the  safe  mode  operation.  Figure  4.122  show  the  ALTAV 
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Figure  4.122:  ATLAV  states  corresponding  to  a  float  fault  in  F\  actuator  and  switching  to 
safe  mode 

states  corresponding  to  the  float  fault  in  F\  actuator  and  control  switching  to  the  safe  mode. 
As  it  is  shown  in  this  figure,  7  and  <f>  converge  to  zero,  x  and  y  coordinates  converge  to 
the  fixed  point  and  one  can  control  the  altitude.  The  same  safe  mode  operation  can  be 
considered  for  the  case  when  there  is  a  fault  in  the  input  channels  F2  and  F4  by  using  the 
input  channels  Fi  and  F3. 

Fault  detection  in  the  safe  mode  operation 

In  this  part,  we  investigate  the  fault  detection  in  the  safe  mode  operation.  As  mentioned 
before,  in  the  safe  mode  operation,  the  input  channels  are  divided  in  two  groups  F\,  F$  and 
F2,  F4  and  the  the  input  channels  in  the  faulty  pair  are  set  to  zero.  Moreover,  the  other  input 
channels  are  used  to  control  the  altitude  of  the  vehicle.  The  same  residuals  773  and  ^4  can 
be  used  in  the  safe  mode  operation  to  detect  the  fault  in  these  two  group,  we  consider  the 
scenario  where  the  float  fault  happens  in  Fi  actuator  at  t  =  100  sec.  and  the  controller 
switch  to  the  safe  mode  operation  after  detection  of  this  fault.  Then  at  t  =  120  second 
the  float  fault  will  happen  in  F4  actuator.  Figure  4.123  shows  the  residual  corresponding  to 
scenario.  As  shown  in  this  figure,  one  can  easily  detect  the  occurrence  of  the  second'fault 
in  F4  in  the  safe  mode  operation.  It  should  be  noted  that  after  switching  to  the  safe  mode 
operation,  the  residual  corresponding  to  the  faulty  pairs  will  go  back  to  zero  since  the  input 
channels  in  that  pair  are  set  to  zero.  Figure  4.124  depicts  the  ALTAV  states  corresponding 
to  this  fault  scenario. 
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Figure  4.123:  Safe  mode  operation  residuals  corresponding  to  a  float  fault  in  F\  and  F4 
actuators 


Figure  4.124:  ATLAV  states  corresponding  to  a  float  fault  in  Fi  and  F4  actuators 

4.3.8  Fault  Diagnosis  for  ALTAV 

In  this  section,  fault  diagnosis  algorithms  will  be  investigated  for  ALTAV  system.  As  it  is 
mentioned  in  the  previous  section,  after  detection  of  the  fault,  the  controller  will  be  switched 
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"  to  the  safe  mode  controller  in  order  to  maintain  the  safety  of  the  vehicle.  In  the  safe  mode 
operation,  the  fault  diagnosis  subsystem  will  be  activated  in  order  to  identify  the  type  of 
,  fault  by  injecting  some  auxiliary  signals  to  the  system. 

Common  actuator  faults  that  are  considered  in  this  work  include  [?]:  (i)  freezing  or  lock 
in-place  (LIP)  fault,  (ii)  float  fault,  (iii)  hard-over  fault  (HOF),  and  (iv)  loss  of  effectiveness 
(LOE)  fault.  In  the  case  of  LIP  fault,  the  actuator  freezes  at  a  particular  situation  and  does 
not  respond  to  subsequent  commands.  HOF  is  characterized  by  the  actuator  moving  to  its 
upper  or  lower  position  limits  regardless  of  the  commanded  signal.  The  actuator  speed  of 
.response  is  bounded  by  the  actuator  rate  limits.  Float  fault  occurs  when  the  actuator  floats 
with  zero  moment  and  does  not  contribute  to  the  control  authority.  Loss  of  effectiveness 
is  characterized  by  lowering  the  actuator  gain  with  respect  to  its  nominal  value.  Different 
types  .of  actuator  faults  may  be  mathematically  parameterized  as  follows: 

No  Failure  Case 
0  <  e  <  k(t )  <  l,Vf  >  fp(LOE) 

Vt  >  fy(Float)  (4.54) 

Vf  >  tF(UP) 

Vt  >  fy(HOF) 

where  tF  denotes  the  time  instant  of  fault  occurrence  in  the  actuator,  k  denotes  its  effective¬ 
ness  coefficient  such  that  k  G  [e,  1]  and  s  denotes  its  minimum  effectiveness,  and  um  and  um 
denote  the  minimum  and  maximum  value  of  the  input  respectively.  The  following  general 
model 

'U'true  (7 kUcuid  -{-  (1  (T^U  (4.55) 

may  integrate  all  the  above  cases  into  a  single  representation,  where  utrUe  is  the  actuator 
output,  ucmd  is  the  output  of  the  controller  (which  at  the  same  time  is  an  input  to  the 
actuator),  a  =  1  and  k  =  1  in  the  no  fault  operating  regime,  <7=1  and  e  <  k  <  1  in 
the  case  of  loss  of  effectiveness  fault  and  a  =  0  in  other  types  of  fault  scenarios.  Finally 
um  <u  <  um  is  the  position  at  which  the  actuator  locks  in  case  of  float,  lock-in-place  and 
hard-over  faults.  It  is  assumed  that  the  fault  has  already  been  detected  and  isolated  by 
using  nonlinear  geometric  FDI  scheme.  For  the  cases  where  the  FDI  algorithm  just  detect 
the  occurrence  of  the  fault  in  one  of  the  input  channels  pairs  ify  F3  and  F2,  F4,  the  proposed 
fault  diagnosis  algorithm  will  be  applied  to  each  channel  in  above  pairs  one  by  one. 

The  general  idea  is  to  apply  some  test  signals  to  the  system  and  use  estimator  to  identify 
the  type  of  fault.  The  main  challenge  is  to  distinguish  between  the  loss  of  effectiveness  fault 
and  other  types  of  fault.  This  is  due  to  the  fact  that  in  the  case  of  float,  lock  in  place  and 
hard  over  faults,  the  real  value  of  the  output  is  constant  but  for  loss  of  effectiveness  fault, 
the  actuator  output  is  not  necessary  constant.  Therefore,  in  order  to  have  the  same  type  of 
signal  as  the  actuator  output,  one  can  choose  the  piece- wise  constant  auxiliary  signal  and  in 
this  case,  all  faults  show  up  as  a  bias  in  the  actuator  and  one  can  model  the  system  as  below 

x  =  f(x)  +  g(x)(ua  +  bf)  (4.56) 

y  =  Cx  (4-57) 

where  bf  denotes  the  constant  bias  of  the  actuator  due  to  the  all  type  of  fault  and  ua  is  the 
auxiliary  input  signal  which  is  constant  and  utTue  =  ua  +  bf.  The  problem  is  now  to  design 


Ucmd, 

k(t)uCmd 

0 

Ucmd(,^F  ) 

um  or  Um 
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an  estimator  for  bf.  According  to  the  type  of  faults  that  have  been  considered  here,  the 
following  auxiliary  signal  can  be  used: 


f  0  ts  <  t  <  ts  +  T 
\  a  ts  T  <  t  <  ts  2 T 


(4.58) 


wherets  is  the  time  instant  that  the  vehicle  switch  to  the  safe  mode,  T  is  the  required  time  for 
the  convergence  of  the  estimator.  Let  bf  denotes  the  estimated  value  of  bf.  It  should  be  noted 
that  it  is  not  always  necessary  to  inject  the  auxiliary  signal  with  two  different  levels.  When 
the  zero  auxiliary  signal  will  be  applied  to  the  vehicle,  if  float  or  loss  of  effectiveness  fault 
has  happened,  then  bf  will  converge  to  zero  value  and  one  cannot  distinguish  between  these 
type  of  fault  and  nonzero  auxiliary  signal  should  be  applied  to  identify  the  fault.  However, 
if  LIP  or  HOV  fault  has  happened  in  the  system,  bf  will  converge  to  the  position  of  the 
actuator  where  it  has  locked  and  there  is  no  need  to  apply  nonzero  auxiliary  signal.  In  the 
case  of  float  or  loss  of  effectiveness  fault,  the  nonzero  auxiliary  signal  ua  =  a  will  be  applied 
to  the  vehicle  and  one  can  find  the  effectiveness  of  the  input  channel  as  follow: 


k  =  a^L  x  100  (4.59) 

a 

Figures  4.125  and  4.126  show  the  corresponding  auxiliary  signals  a  and  bf  for  two  different 
fault  scenarios,  hard  over  fault  and  80%  loss  of  effectiveness  in  F4  actuator,  respectively.  As 
it  is  seen  in  figure  4.125,  there  is  no  need  to  apply  two  different  level  and  bf  —  3.5  determine 
the  type  of  fault  which  in  this  scenario  is  hard  over.  However  in  figure  4.126,  applying  the 
zero  auxiliary  signal  results  in  bf  =  0  will  opt  out  the  possibility  of  hard  over  and  loss  in 
place  fault  and  the  nonzero  one  can  be  used  to  find  the  percentage  of  the  loss  of  effectiveness. 


4.3.9  Fault  recovery  for  ALTAV 

In  this  section,  fault  recovery  procedures  that  can  be  investigated  for  ALTAV  in  future  is 
summarized.  Since  ALTAV  is  not  over  actuated  system,  the  control  allocation  procedures  for 
recovery  are  not  applicable  for  this  system.  However  one  can  investigate  the  controllability  of 
the  faulty  vehicle  for  different  fault  scenario  and  for  each  of  them,  reconfigure  the  controller 
in  order  to  achieve  the  maximum  attainable  performance. 

As  an  example,  consider  the  float  fault  in  input  channel  Fi.  In  this  case,  state  space 
equation  of  ALTAV  may  be  rewritten  as 


Mi  =  (F2  +  F3  +  F4)sm(7)  -  Cxx 
My  =  (F2  +  F3  +  F4)sin((f))  -  Cyy 
Mz  =  —  (F2  +  F3  +  F4)cos{i)cos(4>)  —  Fb  +  Mg 
Je@  =  (— F2Z  +  F3l  —  F4l)sin(p)  —  Cg9 
=  —F3l  -  FBLBsin(pf)  -  C7 7 
J <pj>  =  ~(F2l  -  F4l )  -  FBLBsin{4>)  -  C $<£ 


Czz 


(4.60) 


A  recovery  controller  should  be  design  for  this  faulty  system  by  considering  the  subset  of 
states  that  are  controllable  and  whether  the  vehicle  has  full  maneuverability  in  this  fault 
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Figure  4.126:  Diagnosis  signals  corresponding  to  the  80%  loss  of  effectiveness  fault  in  Fy 
actuator 

scenario.  One  solution  may  be  turning  off  the  actuator  F3  again  and  control  the  vehicle  by 
F2  and  F4.  It  should  be  investigated  that  whether  the  vehicle  can  be  controlled  in  both  y 
and  z  direction  in  contrast  to  the  safe  mode  operation  that  the  vehicle  is  only  controlled  in 
z  direction. 
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Fault  Type 

Detection  Time  (sec) 

Isolation  time  (sec) 

Float 

105.1 

107 

Hard  Over 

105.05 

105.1 

Lock  in  place 

107.1 

- 

20%  LOS 

- 

- 

50%  LOS 

105.1 

- 

80%  LOS 

105.05 

Ill 

Table  4.13:  Detection  time  corresponding  to  fault  scenarios  of  Fx  input  channel 

As  a  second  example,  consider  the  50%  loss  of  effectiveness  in  input  channel  F 2.  In  this 
case  the  state  space  equation  of  ALTAV  my  be  written  as 

Mx  =  (Fi  +  0.5  *  F2  +  F3  +  F4)sin( 7)  —  Cxx 

My  =  (Fx  +  0.5  *  F2  +  F3  +  F4)sin(4>)  —  Cyy 

Mz  =  —{FI  +  0.5  *  F2  +  F3  +  F4)cos{i)cos{4>)  —  Fb  +  Mg  -  Czz 

Jg9  =  (Fxl  —  0.5  *  F2l  +  F3l  —  F4l)sin{p)  —  Cg9 

J77  =  (FI  -  Fa)l  -  FBLBsin{ 7)  -  C7q 

J4&  =  -(0.5  *F2-  F4)l  -  FBLBsin{(j))  -  C ^  (4.61) 

As  it  shown  in  figure  4.64,  the  normal  control  can  control  the  vehicle  in  x  and  z  direction 
completely  but  there  exist  a  tracking  error  in  y  direction  motion.  Therefore,  the  vehicle  still 
has  maneuverability  in  x  and  z  direction  which  it  also  should  be  investigated  analytically. 
Also  it  should  be  investigate  what  is  the  maximum  performance  attainable  in  y  direction. 

As  a  summary,  the  behavior  of  vehicle  for  all  type  of  faults  should  be  investigated  and 
control  recovery  configuration  for  each  fault  scenario  should  be  designed. 


4.3.10  Timing  issue  in  FDIR 

In  this  section,  timing  issue  of  the  proposed  FDIR  is  considered.  As  it  is  mentioned  before, 
the  first  step  in  FDIR  is  fault  detection  and  isolation.  Different  criteria  can  be  chosen  for 
fault  decision  making.  As  an  example,  we  can  set  a  fault  alarm  when  the  flag  corresponding 
to  the  faulty  channel  is  one  for  more  than  5  second.  This  scheme  may  decrease  the  false 
alarm.  Following  table  shows  the  alarm  time  of  different  fault  scenarios  in  input  channels 
for  this  case.  All  faults  are  injected  in  f  =  100  second. 

Other  decision  making  rule  such  as  stochastic  criteria  for  detection  of  abrupt  change  can 
be  used  which  guarantee  the  minimum  false  alarm. 

After  the  fault  is  detected  and  isolated  by  the  FDI  algorithm,  the  controller  will  switch  to 
the  safe  mode  and  fault  diagnosis  algorithm  is  activated.  Fault  diagnosis  require  10  second 
for  identifying  the  fault  in  the  vehicle.  This  interval  can  be  optimized  to  find  the  minimum 
time  for  fault  diagnosis  algorithm.  At  the  last  step,  the  controller  should  be  reconfigured 
according  to  the  type  of  fault.  The  most  important  time  is  the  detection  fault  since  during 
this  interval  the  vehicle  is  faulty  but  the  normal  operation  controller  is  applied  to  the  vehicle 
and  this  may  cause  unstability  and  damage  to  the  vehicle  or  other  vehicle  in  the  neighborhood 
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Fault  Type 

Detection  Time  (sec) 

Isolation  time  (sec) 

Float 

105.05 

109.5 

Hard  Over 

108 

118 

Lock  in  place 

107.0 

- 

20%  LOS 

- 

- 

50%  LOS 

105.1 

- 

80%  LOS 

105.05 

- 

Table  4.14:  Detection  time  corresponding  to  fault  scenarios  of  F2  input  channel 


Fault  Type 

.  Detection  Time  (sec) 

Isolation  time  (sec) 

Float 

105 

Hard  Over 

108 

109 

Lock  in  place 

107 

- 

20%  LOS 

- 

- 

50%  LOS 

105.1 

- 

80%  LOS 

105.05 

- 

Table  4.15:  Detection  time  corresponding  to  fault  scenarios  of  F3  input  channel 


Fault  Type 

Detection  Time  (sec) 

Isolation  time  (sec) 

Float 

105.1 

111 

Hard  Over 

105.05 

Lock  in  place 

106.1 

- 

20%  LOS 

- 

- 

50%  LOS 

113 

- 

80%  LOS 

105.05 

- 

Table  4.16:  Detection  time  corresponding  to  fault  scenarios  of  F4  input  channel 


of  faulty  vehicle.  Therefore  detection  decision  making  should  be  optimized  and  the  maximum 
detection  time  for  all  type  fault  (worse  case)  must  be  considered  in  the  design  of  controller 
in  the  normal  operation.  These  are  the  issue  that  should  be  investigated  in  future. 


4.4  Aerosonde  FDI 

Aerosonde  [53,  4]  is  a  small  autonomous  airplane  designed  for  long-range  weather  data  ac¬ 
quisition.  It  was  developed  especially  for  reconnaissance  over  oceanic  and  remot  areas,  and 
in  harsh  conditions.  Its  low-cost  design  and  operational  flexibility  will  promote  its  usage  for 
a  wide  range  of  remote-sensing  application.  In  this  section,  the  nonlinear  geometric  FDI  will 
be  applied  to  the  lateral  dynamics  of  the  Aerosonde. 
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Figure  4.127:  The  Aerosonde  [4] 

4.4.1  Aerosonde  Model 

Aerosonde’s  dynamics  and  kinematics  can  be  written  by  the  following  equations  []: 


Force  Equations 

mvVr  =  FTcos(a  +  aT)cos(3  —  D  +  mvgi  (4-62) 

mvpVr  —  —FTcos(a  +  or)sm/5  +  C  +  mvg2  —  mvVrrs  (4.63) 

mvaVrCOs(3  =  —FTsin{a  +  ay)  —  L  +  mvg3  +  mvVr(qcosP  —  pssinfi)  (4.64) 

where 

<7i  =  —gDCOs(3sin{9  —  a)  (4.65) 

92  =  gDsin(3sin(Q  -  a?)  (4.66) 

93  =  9dcos{9  -  a)  (4.67) 

Moment  Equations 

Tp  =  Jxz[Jx~  Jy  + Jz)pqF[Jz(Jy- Jz)  —  Jlz}qr  +  Jzl-\- Jxzn  (4.68) 

Jyq  =  {Jz  ~  Jx)pr  -  JXz{p2  ~  r2)  +  m  (4.69) 

Tr  =  \{Jx- Jy)Jx  + Jlz]pq- Jxz[Jx- Jy  + Jz]qr  +  Jxzl  + Jxn  (4.70) 

Where  V  =  JXJZ  -  j£z. 

Kinematic  Equations 

<j>  =  P  +  tan9(qsin<p  +  rcoscp)  (4-71) 

9  =  qcoscp  —  rsincj)  (4.72) 

ip  =  (qsin<p  +  rcosp)  /  cos9  (4.73) 

Navigation  Equations 

Pn  =  U  cBctp  +  V  (—ccpstp  +  s<ps9sip)  +  W  (scpsip  +  c(ps9cip )  (4-74) 

Pe  =  U  c9sip  +  V  ( ccpcip  -F  s(ps9stp )  +  W  (—spctp  -f-  c<ps9sip )  (4-75) 

h  =  U s9  —  V  scpc9  —  W cpc9  (4-76) 
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■ 

V 

■ 

We  will  focus  on  force  equations  and  moment  equations  in  order  to  design  FDI  techniques. 
Aerodynamic  forces  and  moments  are  obtained  based  on  following  equations. 

Aerodynamic  forces : 

i 

D  =  \pV*SCD 

(4.77) 

t 

| 

C  =  ]-PVfSCY 

(4.78) 

A  ' 

L  =  l-PV*SCL 

(4.79) 

§ 

Aerodynamic  moments: 

i 

1 

l  =  ^pVfSbQ 

(4.80) 

if  flh 

m  =  ^pVfScCm 

(4.81) 

<1  ' 

n  =  - PVfSbCn 

(4.82) 

:  i, . 

.The  coefficient  terms  in  the  above  equations  can  be  modeled  as  follows: 

Lift  coefficient  terms: 

i 

Ci  =  Cu  +  Cl-a  +  C%-6,  +  C%-6t  +  7fr{Ci-6,+  Cl-q)  +  C?-M 

z  Vrp 

(4.83) 

:!i 

Drag  coefficient  terms: 

i1 

i 

;■ 

CD  =  CD0  +  +  CSf  ■  Sf  +  CSA  •  5e  +  CsDa  ■  5a  +  Cp  •  8r  +  Cfj  ■  M 

(4.84) 

r ' 

Side  force  coefficient  terms: 

i 

i 

l 

CY  -  C?  ■  f3  +  Csy“  •  5a  +  Cy  .  <5r  +  b  {Cpyp  +  Cry  r) 

£  * a 

(4.85)  . 

1 

Pitch  moment  coefficient  terms: 

■ 

■ 

Cm  =  Cm0  +  CZ-a  +  CSJ-Sj  +  C%-Se  +  ^-(C°-a  +  Cl-q)  +  C“-M 

(4.86) 

Roll  moment  coefficient  terms: 

1 

i 

c,  =  cf  ■  p  +  Cf°  •  Sa  +  Cf  ■  6r  +  (Cf  •  p  +  c;  ■  r ) 

(4.87) 

jl 

Yaw  moment  coefficient  terms: 

|  . 

C„  =  C%-p  +  C%-6'  +  C%-6r  +  -Y-(C’-p  +  <Z-T) 

(4.88) 

‘i 

1 

If; 

H 
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.  Therefore,  considering  these  coefficients,  force  equations  in  the  wind  axis  can  be  rewritten 


as: 


mvVr  =  Frcos(a  +  a^cosfi  —  \pV%S 

& 


+  C%  ■  Se  +  CSD“  •  5a  +  Cp  ■  Sr  +  C™  ■  M 


ireAR 


M 


+  mvg1 


mvpVr  —  —Frcos(a  +  ctT)sinP  +  \pVyS 


Cl  ■  P  +  C*?  •  5a  +  c£  ■  5r 


+  ^(C?-P  +  CJt) 


m 


,vaVTcosP  =  —FTsin(a  +  cty)  —  -zpV^S 

z 


+  mvg2  -  mvVTrs 

1 


C,0  +  C2  +  ci  ■  6,  +  C'i  ■  5, 

(4.91) 

+  rnvgz  +  mvVT{qcosP  -  pssinP ) 


+  2 ^(Ct^  +  C1‘Q)  +  CL-M 


(4.89) 


(4.90) 


4.4.2  Parameter  List 

Aerosonde  parameter’s  values  are  summarized  in  following  tables  [54]. 


Notation 

Description 

Values 

CL0 

zero-alpha  lift 

0.23 

ct 

alpha  derivative 

5.6106 

~cC 

lift  control  (flap)  derivative 

0.74 

~cf: 

pitch  control  (elevator)  derivative 

0.13 

ct 

alpha-dot  derivative 

1.9724 

Cl 

pitch  rate  derivative 

7.9543 

cp 

Mach  number  derivative 

0 

Table  4.17:  Lift  Coefficients 


Notation 

Description 

Values 

Cdo 

minimum  drag 

0.0434 

r<df 

lift  control  (flap)  derivative 

0.1467 

pitch  control  (elevator)  derivative 

0.0135 

(~<ba 

UD 

roll  control(aileron)  derivative 

0.0303 

Ct 

yaw  control  (rudder)  derivative 

0.0303 

c% 

Mach  number  derivative 

0 

Table  4.18:  Drag  Coefficients 
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Notation 

Description 

Values 

d 

sideslip  derivative 

-0.83 

~cf 

rollcontrol  (aileron)  derivative 

-0.075 

~c*r 

yaw  control  (rudder)  derivative 

0.1914 

CPy 

roll  rate  derivative 

0 

CTy 

yaw  rate  derivative 

0 

Table  4.19:  Side  Force  Coefficients 


Notation 

Description 

Values 

CmO 

zero-alpha  pitch 

0.135 

alpha  derivative 

-2.7397 

r$f 

lift  control  (flap)  derivative 

0.0467 

~C% 

m 

pitch  control  (elevator)  derivative 

-0.9918 

alpha-dot  derivative 

-10.3796 

Cl 

m 

pitch  rate  derivative 

-38.2067 

Mach  number  derivative 

0 

Table  4.20:  Pitch  Moment  Coefficients 


Notation 

Description 

Values 

Of 

sideslip  derivative 

-0.13 

roll  control  (aileron)  derivative 

-0.1695 

cf 

yaw  control  (rudder)  derivative 

0.0024 

Cf 

roll  rate  derivative 

-0.5051 

Cl 

yaw  rate  derivative 

0.2519 

Table  4.21:  Roll  Moment  Coefficients 


Notation 

Description 

Values 

c£ 

sideslip  derivative 

-0.0726 

0.0108 

~W~ 

yaw  control  (rudder)  derivative 

-0.0693 

Cp 

roll  rate  derivative 

-0.069 

Cl 

yaw  rate  derivative 

-0.0946 

Table  4.22:  Yaw  Moment  Coefficients 


Notation 

Description 

Values 

c 

mean  aerodynamic  chord 

0.189941  m 

b 

wind  span 

2.8956  m 

S 

wing  area 

Table  4.23:  Aerodynamic  Parameters 
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notation 

zero- fuel 

full  fuel  tank 

mass 

mv 

8.5  kg 

13.5  kg 

moments 

of 

inertia 

Jx 

Jy 

Jz 

Jxz 

CG 

location 

X 

0.156  m 

0.159  m 

y 

0  m 

0  m 

Z 

0.079  m 

0.090  m 

Table  4.24:  Inertia 
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4.4.3  Lateral  motion 

For  lateral  motion,  we  consider  that  angle  of  attack  a.  ,  pitch  angle  and  pitch  rate  are  zero. 
Thus,  the  lateral  dynamics  of  aerosonde  can  be  written  as  follows 


'  mvVT  =  FTcosf3  —  -pV^S 

Li 

mvpVT  =  -FTsin(3  +  ^pV^S 

z 


Cm  +  CSF  •  5a  +  ■  6, 


yD 

-iP  .  a  i  r>ia 


D  Ur 

1 6, 


b 


C$-P  +  C*?  -5a  +  C*?  ■Sr  +  -—(Cpyp  +  Cryr) 

Z  Vj' 


(4.92) 

mvVrr 


Ip  =  Jz--pV*Sb 


C?-P  +  +  Cf-  ■  5r  +  ±r  ( Cf  •  p  +  Cf  •  r ) 

L,  VT 


1 


+JXz  •  ^pvSsb 


Tr  =  Jxz-^pVSSb 


2 

1 

2pXr 
1 


2^Ce-P  +  Ct-5a  +  Ct-5r  +  —(C?n-p+Crn-r) 


(4.93) 


Cf-P  +  Cf*  ■  5 a  +  Cf* •  •  Sr  +  —  ( Cf  ■  p  +  CT  •  r ) 


+J*  '  ^pVSSb 


Ce-p  +  Ct-Sa  +  C5nr.5r  +  —(C?-p  +  C:-r) 


(4.94) 


where  the  inputs  are  Ft,  Sa  and  5r.  Consider  x  =  [Vy  /?  p  r],  the  above  equations  can  be 
written  in  compact  form 


x  =  f(x)  +  gi{x)FT  +  g2(x)5a  +  gz{x)5r 


(4.95)  ; 


where 
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4.4.4  Aerosonde  Control  System 

In  this  section,  a  PID  control  will  be  applied  to  lateral  motion  of  Aerosonde.  More  specifically, 
aileron,  rudder  and  throttle  will  be  used  to  control  roll  angle,  yaw  angle  and  airspeed, 
respectively. 

It  is  important  to  note  that  the  airplane  thrust  Ft  in  (6.8)  -  (6.8)  is  one  of  the  inputs. 
The  airplane  thrust  is  provided  by  propulsion  system,  which  is  affected  by  throttle,  the 
atmospheric  pressure,  the  atmospheric  temperature,  the  air  density,  etc.  The  input  of  the 
propulsion  system  in  our  disposal  is  throttle  which  ranges  from  0  to  1.  Consequently,  in  the 
following  simulation,  the  throttle  is  used  to  control  airspeed. 

The  performance  of  the  PID  control  of  the  Aerosonde  lateral  motion  is  shown  by  Figures 
4.128  -  4.133.  Figures  4.128  -  4.130  depict  the  performance  of  yaw,  airspeed  and  roll  of 
Aerosonde.  Yaw  and  airspeed  are  expected  to  follow  the  steps  shown  by  red  lines  in  the 
figures,  and  roll  is  expected  to  stay  zero  during  the  flight.  One  can  observe  that  the  designed 
PID  control  can  make  the  UAV  follow  the  desired  references,  and  the  input  responses  of  the 
UAV  are  shown  by  Figures  4.131  -  4.133. 
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throttle  rudder  angle  (degree) 


Figure  4.133:  Input  response  of  aileron 
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4.4.5  Aerosonde  Fault  detection  and  Isolation 

In  this  section  the  fault  detection  and  isolation  problem  for  lateral  dynamics  of  aerosonde 
(Equation  (6.8))  is  investigated.  The  nonlinear  geometric  FDI  based  detection  filters  are 
designed  for  different  input  channels.  Three  input  channels  aileron  Sa  ,  rudder  Sr  and  throttle 
Ft  are  used  for  controlling  the  lateral  motion  of  aerosonde.  Due  to  dynamics  of  aerosonde, 
it  is  not  possible  to  find  a  residual  that  is  just  affected  by  one  channel  and  is  decoupled 
from  other  channels.  Therefore,  a  set  of  three  detection  filters  are  designed  such  that  each 
residual  is  decoupled  from  one  input  channel  and  is  affected  by  two  other  channels.  By  using 
the  nonlinear  geometric  FDI  approach  following  new  set  of  states  can  be  found: 


z\  =  log(x  i)  +  x2^§-  (4.96) 

G  Y 

CSr 

z2  =  logixi)  +  x2-^  (4.97) 

Gy 

zz=P  (4.98) 

*4  =  r  (4.99) 


where  the  inverse  mapping  between  the  new  states  and  the  old  states  are 
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Let  Ca  =  and  CT  =  then,  the  state  space  equation  for  new  set  of  states  are: 
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As  it  is  seen  from  above  equation  z\  is  affected  by  Ft  and  Sr,  z2  is  just  affected  by  Ft  and 
6 a  and  z3  is  just  affected  by  5a  and  5r.  Therefore  one  need  to  design  an  observer  for  zi,z2 
and  z3.  For  designing  the  observer  for  zi;  all  other  states  z3 ,  j  ^  i  are  considered  as  the 
independent  inputs.  Therefore  following  three  high  gain  observers  may  be  designed: 
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and  the  residuals  can  be  defined  as 


rQ  =  21  -  21 
rr  =  z2-  z2 
Tf  —  ZZ  —  23 


(4.104) 

(4.105) 

(4.106) 


Following  table  will  be  used  for  fault  detection  and  isolation  decision  making: 


4.4.6  Simulation  Results 

In  this  section,  simulation  results  of  our  proposed  nonlinear  FDI  scheme  when  applied  to  the 
lateral  motion  of  aerosonde  model  will  be  presented.  Different  actuator  faults  are  considered 
in  all  input  channels.  We  have  considered  a  measurements  noise  v  as  uniform  random  noise. 
Figure  4.134  shows  the  desired  and  actual  aerosonde  lateral  states  in  the  normal  or  healthy 
operation  and  figure  4.135  shows  the  corresponding  residuals  in  this  mode.  By  considering 
the  maximum  value  of  residuals  in  the  normal  mode  and  some  safety  factor,  the  threshold 
value  of  0.02  was  considered  for  all  residuals. 
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Threshold  exceeds 

Threshold  does  not  exceed 

detected  fault 

ra 

rr,rF 

rudder  or  engine 

rT 

ra,rF 

aileron  or  engine 

rF 

ra,rr 

aileron  or  rudder 

rr,rF 

ra 

aileron 

ra,rF 

r> 

rudder 

ra,ra 

rF 

engine 

ra,ra,rF 

~ 

Concurrent  faults 
in  two  channels  or  more 

Table  4.25:  Detection  and  isolation  of  Faults  in  aerosonde 


Figure  4.134:  Aerosonde  states  corresponding  to  a  normal  operation  (healthy  mode)  of* 
aerosonde 

Figure  4. 136  shows  the  residuals  corresponding  to  a  float  fault  in  the  aileron.  As  shown  in 
this  figure  the  residuals  ry  and  rF  exceed  their  thresholds  while  residual  ra  remains  below  the 
threshold.  According  to  table  6.2  one  can  detect  the  occurrence  of  the  fault  in  the  aileron. 
Figure  4.137  demonstrates  the  states  of  aerosonde  in  this  faulty  scenario  which  implies  that 
the  aerosonde  becomes  unstable  due  to  this  fault.  Figures  4.138  and  4.140  show  the  residuals 
corresponding  to  a  hard  over  and  lock  in  place  fault  in  the  aileron  respectively.  According  to 
these  figures  and  table  6.2  ,  one  can  easily  detect  and  isolate  this  fault.  As  shown  in  figures t 
4.139  and  4.141  ,  the  aerosonde  becomes  unstable  in  both  scenarios.  Figure  4.142  depicts 
the  residuals  corresponding  to  a  20%  loss  of  effectiveness  fault  in  the  aileron.  According 
to  this  figure  one  can  only  detect  the  fault  but  cannot  isolate  between  aileron  and  rudder. 
Moreover,  as  shown  in  figure  4.143,  the  controller  compensates  this  fault  and  there  exist  just 
some  transient  effect  on  the  aerosonde  states.  Figures  4.144  and  4.146  show  the  residuals 
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corresponding  to  the  50%  and  80%  loss  of  effectiveness  in  the  aileron  respectively.  In  these 
two  scenarios  also,  one  can  detect  and  isolate  the  fault  in  the  aileron.  Figures  4.145  and 
4.147  depict  the  states  of  the  aerosonde  for  50%  and  80%  loss  of  effectiveness  in  the  aileron 
respectively.  According  to  these  figures,  the  controller  can  recover  from  the  50%  loss  of 
effectiveness  fault,  while  the  80%  loss  of  effectiveness  destabilize  the  aerosonde. 
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Figure  4.138:  Residuals  corresponding  to  a  Hard  over  fault  in  the  aileron 
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Figure  4.147:  Aerosonde  states  corresponding  to  a  80%  loss  of  effectiveness  fault  in  the 
aileron 
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Figure  4.148:  Residuals  corresponding  to  a  float  fault  in  the  rudder 

Figure  4.148  shows  the  residuals  corresponding  to  a  float  fault  in  the  rudder.  As  shown  in 
this  figure  the  residuals  ra  and  exceed  their  thresholds  while  residual  rr  remains  below  the 
threshold.  According  to  table  6.2  one  can  detect  the  occurrence  of  the  fault  in  the  rudder. 
Figure  4.149  demonstrates  the  states  of  aerosonde  in  this  faulty  scenario  which  implies  that 
the  aerosonde  cannot  track  the  yaw  reference  trajectory  but  it  will  remain  stable.  Figures 
4.150  and  4.152  show  the  residuals  corresponding  to  a  hard  over  and  lock  in  place  fault  in 
the  rudder  respectively.  According  to  these  figures  and  table  6.2  ,  one  can  easily  detect  and 
isolate  these  faults  in  the  rudder.  As  shown  in  figures  4.151  and  4.153  ,  in  both  scenarios  the 
aerosonde  remains  stable  but  cannot  track  the  yaw  reference  trajectory.  Figure  4.154  depicts 
the  residuals  corresponding  to  a  20%  loss  of  effectiveness  fault  in  the  rudder.  According  to 
this  figure  one  can  only  detect  the  fault  but  cannot  isolate  between  rudder  and  engine. 
Moreover,  as  shown  in  figure  4. 155,. the  controller  compensates  this  fault  and  there  exist  just 
some  transient  effect  on  the  aerosonde  states.  Figures  4.156  and  4.158  show  the  residuals 
corresponding  to  the  50%  and  80%  loss  of  effectiveness  in  the  rudder  respectively.  In  these 
two  scenarios  also,  one  can  detect  and  isolate  the  fault  in  the  rudder.  Figures  4.157  and 
4.159  depict  the  states  of  the  aerosonde  for  50%  and  80%  loss  of  effectiveness  in  the  rudder 
respectively.  According  to  these  figures,  the  controller  can  recover  from  the  50%  loss  of 
effectiveness  fault,  while  the  80%  loss  of  effectiveness  causes  the  steady  state  error  in  yaw 
angle. 
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Figure  4.153:  Aerosonde  states  corresponding  to  a  lock  in  place  fault  in  the  rudder 
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Figure  4.155:  Aerosonde  states  corresponding  to  a  20%  loss  of  effectiveness  fault  in  the 
rudder 
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Figure  4.156:  Residuals  corresponding  to  a  50%  loss  of  effectiveness  fault  in  the  rudder 
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Figure  4.157: 
rudder 
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Figure  4.160:  Residuals  corresponding  to  a  float  fault  in  the  engine 

Figure  4.160  shows  the  residuals  corresponding  to  a  float  fault  in  the  engine.  As  shown 
in  these  figure  the  residuals  ra  and  rT  exceed  their  thresholds  while  residual  rp  remains 
below  the  threshold.  According  to  table  6.2  one  can  detect  the  occurrence  of  the  fault  in 
the  engine.  Figure  4.161  demonstrates  the  states  of  aerosonde  in  this  faulty  scenario  which 
implies  that  the  aerosonde  cannot  track  the  yaw  and  speed  reference  trajectories  but  it  will 
remain  stable.  Figure  4.162  shows  the  residuals  corresponding  to  a  hard  over  and  lock  in 
place  fault  in  the  engine.  According  to  this  figure  and  table  6.2  ,  one  can  easily  detect  and 
isolate  this  faults  in  the  engine.  As  shown  in  figure  4.163  the  aerosonde  remains  stable  but 
cannot  track  the  speed  reference  trajectory.  Figure  4.164  depicts  the  residuals  corresponding 
to  a  20%  loss  of  effectiveness  fault  in  the  engine.  According  to  this  figure  one  can  detect  and 
isolate  the  fault  in  the  engine.  Moreover,  as  shown  in  figure  4.165,  the  controller  can  recover 
from  this  fault.  Figures  6.6  and  4.168  show  the  residuals  corresponding  to  the  50%  and  80% 
loss  of  effectiveness  in  the  engine  respectively.  In  these  two  scenarios  also,  one  can  detect  and 
isolate  the  fault  in  the  engine.  Figures  6.5  and  4.169  depict  the  states  of  the  aerosonde  for 
50%  and  80%  loss  of  effectiveness  in  the  engine  respectively.  According  to  these  figures,  in 
both  cases,  the  aerosonde  remains  stable  but  there  exist  the  steady  state  error  in  the  speed. 
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Figure  4.165:  Aerosonde  states  corresponding  to  a  20%  loss  of  effectiveness  fault  in  the 
engine 
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Figure  4.166:  Residuals  corresponding  to  a  50%  loss  of  effectiveness  fault  in  the  engine 
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Figure  4.169:  Aerosonde  states  corresponding  to  a  80%  loss  of  effectiveness  fault  in  the 
engine 
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Chapter  5 

Neural  Network  Based  FDIR 

5.1  Introduction  to  Robust  Fault  Detection  and  Isola¬ 
tion 

Model-based  fault  diagnosis  (FD)  approaches  rely  on  the  key  assumption  that  a  perfectly 
accurate  and  complete  mathematical  model  of  the  system  under  supervision  is  available. 
However,  such  assumption  is  usually  not  valid  in  practice  since  it  is  difficult  to  obtain  the 
necessary  modeling  accuracy  required  for  construction  of  reliable  analytical  redundancy- 
' ’based  FD  architectures.  Unavoidable  uncertainties  that  arise  due  to  modeling  errors,  pa¬ 
rameter  variations,  time  variations,  unknown  external  disturbances,  and  measurement  noises 
deteriorate  the  performance  of  the  FD  schemes  by  causing  false  alarms.  This  performance 
deterioration  can  happen  to  an  extent  that  makes  the  model-based  FD  scheme  totally  use¬ 
less.  This  necessitates  the  development  of  FD  algorithms,  which  have  the  ability  to  reliably 
detect  as  well  as  isolate  faults  and  failures  in  the  presence  of  modeling  uncertainties.  Such 
algorithms  are  referred  to  as  robust  fault  diagnosis  schemes. 

To  overcome  the  difficulties  introduced  by  modeling  uncertainties,  a  model-based  FDI : 
has  to  be  made  robust,  i.e.  insensitive  to  modeling  uncertainty  [55].  However,  sometimes, ; 
merely  reducing  the  sensitivity  to  modeling  uncertainties  does  not  solve  the  problem  because  , 
such  a  sensitivity  reduction  may  be  undesirably  accompanied  by  a  reduction  of  the  sensitivity 
to  faults.  Thus,  a  more  meaningful  formulation  of  the  robust  FDI  problem  is  to  increase , 
the  robustness  to  modeling  uncertainty  without  losing  sensitivity  to  faults.  In  conclusion, , 
an  FDI  scheme  designed  to  provide  satisfactory  sensitivity  to  faults,  associated  with  the  , 
necessary  robustness  with  respect  to  modeling  uncertainty,  is  called  a  robust  FDI  scheme.  < 
The  importance  of  robustness  in  model-based  FDI  has  been  widely  recognized  by  both » 
academia  and  industry.  More  specifically,  robust  FDI  for  linear  systems  has  been  extensively 
investigated  by  many  researchers  during  the  last  two  decades.  As  a  result,  a  number  of  meth¬ 
ods  have  been  proposed  to  tackle  the  linear  robust  FDI  problem  [55]  such  as  the  unknown 
input  observer  (UIO)  method  [56],  eigen-structure  assignment  [57],  and  optimally  robust 
parity  relation  methods  [58].  However,  the  problem  of  robust  FDI  for  nonlinear  systems  has 
not  been  investigated  as  extensively  as  its  linear  counterpart.  More  specifically,  when  the 
'  isolation  of  the  faults  in  the  nonlinear  system  is  required  rather  than  just  detecting  them, 
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very  few  works  have  been  reported  in  the  literature. 

Traditionally,  the  robust  FDI  problem  for  nonlinear  dynamic  systems  has  been  ap¬ 
proached  in  two  steps.  Firstly,  the  model  is  linearized  at  an  operating  point,  and  then  robust 
linear  FDI  techniques  axe  applied  to  generate  residuals  that  are  insensitive  to  modeling  un¬ 
certainties  but  responsive  to  faults.  This  method  only  works  well  when  the  linearization  does 
not  cause  a  large  mismatch  between  linear  and  nonlinear  models  and  the  system  operates 
close  to  the  operating  point  specified.  As  another  alternative  to  robust  nonlinear  FDI,  one 
might  think  of  just  simply  increasing  the  threshold  levels  of  the  residuals  generated  by  the 
nonlinear  FDI  scheme  and  thus  reducing  the  number  of  false  alarms.  However,  this  increase 
in  the  threshold  levels  will  at  the  same  time  decrease  the  fault  sensitivity  of  the  FDI  scheme. 
This  imposes  a  tradeoff  between  reducing  the  number  of  false  alarms  and  missing  to  detect 
the  presence  of  an  actually  occurred  fault.  A  reliable  solution  to  such  a  trade-off  problem  is 
not  trivial  in  practice  specially  due  to  the  nonlinear  behavior  of  system  dynamics  and  the 
presence  of  different  sources  of  unknown  uncertainties.  Therefore,  there  is  a  high  demand 
for  development  of  techniques  that  make  the  nonlinear  FDI  problem  robust  to  modeling 
uncertainties,  that  is,  remarkably  reducing  the  number  of  false  alarms  when  the  nonlinear 
system  is  under  healthy  mode  of  operation,  whilst  reliably  detecting  the  presence  of  faults 
or  failures. 

Robustness  in  the  analytical  redundancy-based  framework  to  FDI  is  usually  achieved  by 
either  making  the  residual  generation  process  or  the  residual  evaluation  process  insensitive  to 
modeling  uncertainties.  In  this  work  we  will  take  the  former  viewpoint  and  propose,  design 
.and  develop  a  residual  generation  scheme  that  is  robust  to  modeling  uncertainties.  We  will 
use  neural  networks  for  this  purpose  due  to  their  distinguished  ability  to  implement  and 
approximate,  to  an  arbitrary  level  of  accuracy,  any  continuous  nonlinear  static  or  dynamic 
function,  given  suitable  network  parameters  (or  weights),  architecture  and  learning  algorithm 
[59].  Neural  networks  have  been  widely  used  in  many  engineering  domains  such  as  nonlinear 
control  [60]  [61],  nonlinear  system  identification  [60],  and  nonlinear  state  estimation  [62] 
[63]  and  the  fault  diagnosis  application  field  is  by  no  means  an  exception.  There  have 
been  a  large  number  of  publications  on  neural  networks- based  FDI,  e.g.  [64]  [65]  [66]  [67]. 
However,  the  major  shortcomings  of  these  works  are  the  negligence  of  the  possible  presence 
of  mathematical  models  of  the  system  and  consequently  the  lack  of  formal  and  analytical 
results  on  the  performance  of  the  FDI  subsystem.  Furthermore,  they  are  mainly  focused  on 
the  fault  detection  problem  rendering  the  fault  isolation  issue  unsolved. 

The  salient  feature  of  our  robust  FDI  scheme  is  that  the  neural  network  capabilities 
in  dealing  with  unknown  nonlinearities  are  exploited  as  a  robustifying  tool  on  top  of  the 
nonlinear  geometric  FDI  approach,  which  was  presented  in  the  previous  sections.  This  has 
two  main  advantages: 

(i)  The  very  powerful  capabilities  of  the  nonlinear  geometric  approach  in  fault  isolation, 
as  shown  previously,  will  be  exploited.  Thus,  we  don’t  need  to  design  an  extra  FDI 
algorithm. 

(ii)  Existence  of  analytical  proofs  for  model-based  approaches  like  nonlinear  geometric  FDI 
make  the  whole  FDI  scheme  analytically  tractable  and  thus  more  reliable. 

In  conclusion,  the  proposed  robust  nonlinear  FDI  scheme  will  be  able  to  simultaneously 
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benefit,  within  a  hybrid  framework,  from  the  existence  of  mathematical  models  and  highly 
reliable  performance  of  model-based  geometrical  FDI  method,  and  the  superior  capabilities 
of  neural  networks  in  estimating  unknown  nonlinear  dynamic  functions.  In  sequel,  the  details 
of  the  proposed  robustifying  scheme  are  provided. 

5.2  Hybrid  Framework  to  Robust  FDI 

The  model-based  nonlinear  geometric  FDI  scheme,  presented  in  chapter  4,  is  depicted  in 
Figure  5.1  where  the  appropriate  state  and  output  transformations  have  to  be  determined 
leading  to  a  quotient  subsystem  unaffected  by  all  faults  but  one.  Hence,  the  state  and  output 
transformations  and  residual  generators  (nonlinear  observers,  etc.)  have  to  be  designed  for 
each  possible  fault.  In  the  ideal  scenario,  for  a  particular  fault,  the  corresponding  residual 
should  remain  close  to  “zero”  when  the  corresponding  fault  is  not  present,  and  remain 
above  “zero”  when  the  fault  occurs.  Highly  reliable  performance  of  the  geometric  FDI 
in  detecting  and  isolating  different  types  of  faults  was  verified  using  numerous  simulation 
results.  It  was  assumed  that  the  mathematical  model  of  the  system  used  for  the  design  of 
state  transformation  and  observers  completely  matches  the  real  system  dynamics.  However, 
any  discrepancies  between  the  mathematical  model  and  the  actual  system,  due  to  un-modeled 
dynamics  and/or  parameter  uncertainties,  will  reflect  themselves  in  the  residuals  generated 
by  the  geometric  FDI  scheme.  Thus,  even  in  the  absence  of  faults  in  the  system,  the  residuals 
will  not  remain  close  “zero”  and  will  exceed  their  thresholds  and  consequently  trigger  a  false 
alarm. 


Figure  5.1:  Model-based  FDI  diagram 

Only  a  few  number  of  publications  in  robust  nonlinear  fault  diagnosis  has  been  reported  in 
the  literature  [68]  [69]  [70].  However,  their  emphasis  is  on  fault  detection  and  neural  network- 
based  fault  severity  estimation  without  addressing  the  problem  of  fault  isolation.  The  novelty 
of  our  work  is  in  the  use  of  neural  networks  in  conjunction  with  the  mathematically  proven 
nonlinear  geometric  FDI  approach,  which  makes  not  only  the  detection  but  also  the  isolation 
of  faults  possible  even  in  the  presence  of  modeling  uncertainties  with  minimum  false  alarms. 
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Figure  5.2:  Closed-loop  simulation  to  evaluate  modeling  uncertainties  effects  on  the  FDI 
Subsystem 


5.3  Effect  of  Uncertainties  on  the  FDI  Subsystem  Resid 
uals 

Although  the  robust  FDI  scheme  that  we  have  developed  in  this  project  is  general  in  nature, 
we  have  verified  its  applicability  and  performance  only  for  ALTAV  platform.  Thus,  consider 
the  mathematical  model  of  the  ALTAV  dynamics  given  in  equation  4.35.  To  account  for 
modeling  uncertainties,  we  will  introduce  deviations  in  the  parameters  of  the  mathematical 
model  of  the  system  from  their  nominal  values.  In  other  words,  we  assume  that  the  physical 
parameters  of  the  actual  system  do  not  perfectly  match  their  corresponding  nominal  values 
derived  at  the  time  of  modeling.  This  is  a  viable  assumption  since  exact  determination 
of  some  of  these  parameters  such  as  the  inertias  or  aerodynamic  drag  is  not  practically 
feasible.  We  may  name  the  mathematical  model  of  the  system  with  perturbed  parameters, 
the  perturbed,  model  of  the  system.  We  need  the  notion  of  the  perturbed  model  due  to 
inaccessibility  of  the  actual  ALTAV  platforms  for  robust  FDI  test  and  verification  purposes. 
Clearly,  the  perturbed  model  can  be  considered  as  a  mathematical  representation  of  the 
actual  system  in  the  absence  of  the  platforms  even  in  the  presence  of  parameter  uncertainties. 

Then,  we  will  simulate  the  closed-loop  system  with  both  the  nominal  model  and  the  per¬ 
turbed  model  operating  in  parallel,  while  the  FDI  subsystem  is  receiving  both  the  perturbed 
model  outputs  and  the  common  control  signals  as  inputs.  The  block  diagram  representation 
of  such  a  simulation  scheme  is  depicted  in  Figure  5.2. 

The  reason  for  running  the  nominal  model  in  parallel  to  the  perturbed  model  is  just  to 
evaluate  the  effect  of  the  introduced  parameter  uncertainties  on  the  system  outputs.  More 
precisely,  the  difference  between  the  outputs  of  the  nominal  model  and  the  perturbed  model 
represents  the  effect  of  uncertainties. 

The  parameters  of  ALTAV,  refer  to  equation  (4.35),  that  have  been  perturbed  from  their 
nominal  values  are  listed  in  Table  5.1  with  the  magnitude  of  perturbations/uncertainties 
stated  in  percentage  for  training.  In  this  report,  two  testing  scenarios  will  be  considered,  in 
which  the  parameters  are  described  by  Table  5.2. 

Figures  5.3  to  5.14  show  the  simulation  results  for  all  the  twelve  outputs  of  the  perturbed 
and  the  nominal  model  of  the  ALTAV  with  rectangular  reference  trajectory  for  the  ALTAV. 
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Table  5.1:  Parameter  Uncertainties  of  Training  Scenario 


Parameters 

Nominal  Values 

Amount  of  Uncertainties  (%) 

C7 

0.5 

15 

0.5 

15 

J 

1.005 

10 

J(j> 

1.005 

10 

Lb 

0.16 

15 

Table  5.2:  Parameter  Uncertainties  of  Testing  Scenarios 


Parameters 

C7 

0* 

J y 

J [ ■p 

Lb 

Nominal  values 

1.005 

1.005 

0.16 

Amount  of 
Uncertainties  (%) 

Test  1 

0 

0 

0 

0 

0 

Test  2 

30 

30 

20 

30 

state  response 


Figure  5.3:  state  x  with  uncertainties 

Although  the  sensitivity  of  the  outputs  of  the  perturbed  model  of  the  ALTAV  pretty  much 
depends  on  the  robustness  of  the  ALTAV  controller,  it  can  be  easily  seen  from  the  figures 
that  the  presence  of  uncertainties  has  generated  a  considerable  impact  on  the  some  of  output 
signals.  This  emphasizes  the  fact  that  the  modeling  uncertainties  could  cause  significant 
discrepancies  between  the  actual  system  behavior  and  the  nominal  model  behavior  that  is 
utilized  in  the  FDI  design. 
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Figure  5.4:  state  x  with  uncertainties 


state  response 
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Figure  5.5:  state  y  with  uncertainties 
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Figure  5.6:  state  y  with  uncertainties 
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Figure  5.13:  state  <j>  with  uncertainties 
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Figure  5.14:  state  </>  with  uncertainties 


The  FDI  subsystem  residuals  in  the  presence  of  uncertainties  and  in  the  absence  of  faults 
are  also  given  in  Figures  5.15.  It  is  worth  to  emphasize  that  the  perturbed  model  outputs, 
as  opposed  to  the  nominal  model  outputs,  are  fed  to  the  FDI  subsystem,  as  shown  in  Figure 
5.2.  This  is  quite  reasonable  since  in  real  operational  conditions  the  only  available  signals 
are  the  measured  outputs  of  the  actual  ALTAV  platform. 
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Figure  5.15:  All  uncompensated  residuals  in  the  presence  of  modeling  uncertainties  (Test  2 
scenario) 

As  can  be  seen  in  Figures  5.16  and  5.17,  in  the  presence  of  the  introduced  parameter 
uncertainties,  at  least  one  of  the  two  residuals  r13,  r2 4  are  beyond  their  associated  threshold 
bounds  over  a  window  of  time,  even  though  there  is  no  fault  in  the  system.  This  will  cause 
the  generation  of  false  alarms  by  the  FDI  subsystem. 

It  should  be  noted  that  the  return  of  the  ri3  residual  to  within  the  threshold  bounds  at 
around  t  =  120(sec)  is  due  to  the  nature  of  the  reference  trajectory  of  the  ALTAV,  which  was 
set  to  rectangular  as  mentioned  before.  More  precisely,  after  a  complete  turn  from  one  side 
of  the  rectangle  to  the  other  perpendicular  side,  the  value  of  the  state  7  and  consequently 
the  effect  of  introduced  uncertainties  on  the  states  7,  7  become  identically  zero.  Thus,  the 
effect  of  uncertainties  is  not  observable  in  the  two  states  7,  7  during  the  travel  of  the  ALTAV 
over  two  of  the  parallel  sides  of  the  rectangular  reference  trajectory.  However,  during  the 
above-mentioned  period  of  time,  the  FDI  subsystem  still  observes  the  effect  of  modeling 
uncertainties  through  the  ri3  residual,  thus  again  generating  false  alarms.  Moreover,  with 
a  general  reference  trajectory,  both  residuals  r13,  r2 4  will  remain  out  of  their  bounds,  both 
causing  false  alarms. 
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Residual  under  test  2  scenario 


Figure  5.16:  Uncompensated  residual  ri3  in  the  presence  of  modeling  uncertainties  (Test  2 
scenario) 


5.3.1  Mathematical  Representation  of  the  Effect  of  Modeling  Un¬ 
certainties 

In  this  section,  we  will  derive  a  state-space  representation  of  the  effect  of  uncertainties  on  the 
system  outputs.  Towards  this  end,  let  us  consider  the  nominal  model  of  a  general  nonlinear 
dynamical  system  with  full  state  measurement  and  no  uncertainties: 


An  =  Fn(xn,u ) 

Un  =  xN  (5.1) 

where  Xn  €  is  the  state  vector  of  the  nominal  system,  u  G  is  the  control  vector  and 
Fn  :  5?"  x  is  a  nonlinear  vector  function  representing  the  nominal  nonlinear  state 

transition  function  of  the  system.  However,  modeling  uncertainties  always  exist  in  practice. 
Thus,  the  actual  system  dynamics,  may  be  represented  by  the  following  nonlinear  state-space 
equations: 


Xr  =  F^(xr,  u)  +  5(xr,  u) 

yr  =  xr  (5-2) 

where  xT  G  9?n  is  the  state  vector  of  the  actual  system  and  8  :  5Rn  x  is  an  unknown 

continuous  nonlinear  vector  function  representing  the  modeling  uncertainties  as  a  nonlinear 
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Figure  5.17:  Uncompensated  residual  m  in  the  presence  of  modeling  uncertainties  (Test  2 
scenario) 

function  of  system  states  and  inputs. 

By  defining  the  effect  of  uncertainties  on  system  states  as  the  difference  between  the 
states  of  the  actual  system  and  the  states  of  the  nominal  model  given  the  same  control  input 
Signals,  we  have: 

Xud  Xr  Xjy  (5.3) 

where  xud  is  the  effect  of  uncertainties  on  system  states.  Using  full  state  measurement 
assumption  and  equation  5.3  we  get: 

Vud  Vr  UN  Xr  Xpf  •Cud  (5*4) 

where  yr  G  are  the  actual  measurements  of  the  system,  i/n  G  are  the  outputs  of  the 
nominal  model  of  the  system  and  yUd  represents  the  effect  of  uncertainties  on  system  outputs.  ’ 
Taking  the  time  derivative  of  both  sides  of  the  equality  in  equation  5.3  and  using  equations* 
5.1  and  5.2,  we  have: 

•&ud  r  3*N 

—  FN(xr,u)  +  8(xr,u)  -  Fn(xn,u)  (5.5)' 

Replacing  from  equality  =  xr—xud  into  equation  5.5,  and  using  equation  5.4  we  have: 

xud  =  FN(xr ,  u)  -  FN{xr  -  xud ,  u)  +  S(xr,  u) 

Vud  =  Xud 
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(5,6) 


Equation  5.6  is  a  nonlinear  state-space  representation  of  a  dynamical  system  with  xud 
as  states  and  xr,u  as  inputs.  Thus,  equation  5.6  can  be  considered  as  the  mathematical 
dynamic  representation  of  the  effect  of  uncertainties  on  the  system  states.  Equation  5.6  can 
be  rewritten  in  the  following  compact  form: 

3'ud  —  2-r  j  ^0 

Vud  d  (5-7) 

where  ip  :  5ira  x  — >  5?"  is  an  unknown  nonlinear  function  due  to  the  unknown  nature  of 

the  function  <5(., .). 

5.4  Neural  Networks  in  the  Hybrid  FDI  Framework 

Careful  investigation  of  Figure  5.2  reveals  that  from  signal  flow  point  of  view,  the  effect  of 
modeling  uncertainties  will  be  propagated  to  the  residual  generation  process  of  the  geometric 
FDI  scheme  through  the  actual  system  outputs  or  measurements,  represented  by  the  out¬ 
puts  of  the  perturbed  model.  So,  in  order  to  avoid  false  alarms,  we  need  to  cancel  out  the 
effect  of  modeling  uncertainties  on  the  system  outputs  and  provide  the  FDI  subsystem  with 
clean/compensated  outputs. 

In  order  to  generate  a  set  of  clean/compensated  outputs  for  the  FDI  subsystem,  we  have 
to  subtract  the  effect  of  modeling  uncertainties  from  system  measurements.  However,  as, 
mentioned  previously,  the  unknown  nature  of  the  effects  of  modeling  uncertainties  does  not 
allow  the  exact  quantification  of  those  effects.  In  other  words,  it  is  practically  impossible  to 
precisely  and  formally  describe  modeling  uncertainties  using  differential  or  algebraic  equa-  ■ 
tions  for  the  purpose  of  incorporating  them  in  the  design  of  model-based  FDI  algorithms. 
Thus,  we  need  to  approximate  the  unknown  effects  of  modeling  uncertainties  in  one  way  or 
another  and  then  subtract  the  estimated  effects  from  system  output  measurements. 


Figure  5.18:  Structure  of  the  hybrid  robust  FDI  scheme 

It  is  well-known  that  dynamic  neural  networks  (DNN)  are  capable  of  approximating 
any  nonlinear  dynamic  system  provided  sufficient  number  of  layers  and  neurons  are  selected. 
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Thus,  we  will  exploit  DNN  to  approximate  the  dynamics  of  the  modeling  uncertainties,  given 
in  equation  5.7,  to  an  arbitrary  level  of  accuracy.  The  neural  network  will  learn  the  dynamics 
of  the  modeling  uncertainties  through  a  learning/trainig  process.  Thus,  the  trained  neural 
network  is  used  in  the  on-line  operation  of  the  ALTAV,  where  the  same  control  signals,  gen¬ 
erated  by  the  ALTAV  controller,  will  be  applied  to  the  inputs  of  the  neural  network.  The 
block-diagram  representation  of  the  proposed  robust  FDI  scheme  with  a  trained  dynamic 
neural  network  as  the  estimator  of  the  modeling  uncertainties  effects  is  provided  in  Figure 
5.18. 

The  data  used  for  DNN  training  corresponds  to  the  non-faulty  scenario  and  the  parame¬ 
ters  of  the  DNN  are  adjusted  such  that  the  network  can  compensate  the  undesirable  effects 
of  the  modeling  uncertainties  on  system  measurements  that  are  fed  to  the  model-based  FDI 
residual  generator.  The  block-diagram  representation  of  the  DNN  training  process  is  de¬ 
picted  in  Figure  5.19.  When  the  training  is  completed,  the  parameters  of  the  network  will 
be  fixed  or  frozen  and  saved  to  be  used  in  the  on-line  operation  shown  in  Figure  5.18.  The 
identification  of  a  nonlinear  dynamic  system  using  neural  networks  will  be  discussed  in  the 
next  section. 


Figure  5.19:  Structure  of  the  DNN  training  scheme  for  identification  of  modeling  uncertainties 


5.5  Identification  of  Modeling  Uncertainties  using  Dy¬ 
namic  Neural  Networks 

As  mentioned  previously,  neural  networks  are  very  powerful  tools  in  estimating  unknown 
nonlinear  functions.  However,  the  most  original  representations  of  the  neural  networks  do 
not  incorporate  any  dynamics  in  the  network  architecture.  Thus,  they  can  not  be  employed 
to  approximate  nonlinear  dynamic  systems  represented  by  nonlinear  state-space  equations 
such  as  the  one  in  equation  5.7.  Consequently,  we  require  neural  networks  with  dynamic 
elements  incorporated  into  their  architecture  that  are  capable  of  representing  nonlinear  dy¬ 
namic  systems  or  equations.  In  general,  such  neural  network  architectures  are  called  dynamic 
neural  networks  ( DNN). 

There  is  a  large  amount  of  publications  on  addressing  the  problem  of  introducing  dy¬ 
namics  into  the  architecture  of  neural  networks.  As  a  result,  different  DNN  architectures 
have  been  proposed  and  developed  in  the  literature.  In  the  next  section,  we  will  introduce 
some  of  these  architectures  utilized  primarily  for  nonlinear  dynamic  system  identification 
and  eventually  select  one  that  suits  our  robust  FDI  scheme  the  best. 


5.5.1  Literature  Review  of  Dynamic  Neural  Networks  for  System 
Identification 

A  large  body  of  literature  has  been  dedicated  to  the  identification  of  a  general  class  of  non¬ 
linear  dynamic  system  using  neural  networks.  These  work  are  motivated  from  and  justified 
by  the  following  three  important  features  of  neural  networks  [71],  namely  (i)  their  nonlin¬ 
ear  characteristics  that  make  them  suitable  for  dealing  with  nonlinear  systems,  (ii)  their 
parallel  and  pipeline  processing  characteristics  that  allow  them  to  perform  different  tasks 
more  efficiently,  and  (iii)  their  learning  characteristics  that  are  ideal  for  adapting  to  different 
environmental  conditions. 

Among  the  work  in  the  literature  one  may  classify  the  schemes  into  four  main  categories. 
The  first  category  ([72],  [60])  utilize  tapped  delay  lines  along  with  a  static  network  to  generate 
dynamics  in  the  structure.  Basically,  in  this  method  delay  elements  are  used  to  introduce 
delayed  inputs  and  outputs  that  are  then  fed  to  a  static  network  as  the  regressor  vector.  The 
network  then  performs  a  static  nonlinear  map  on  this  regressor  vector  so  that  the  desired 
output  is  obtained. 

The  second  category  is  the  recurrent  neural  networks.  In  this  approach  by  using  a 
recurrent  structure  a  dynamic  input-output  representation  is  constructed.  This  method  has 
been  investigated  in  [73],  [74],  [75].  Especially,  in  [73]  it  is  shown  analytically  that  the 
proposed  recurrent  neural  network  is  capable  of  identifying  any  nonlinear  dynamic  system 
provided  that  the  initial  states  of  the  network  are  chosen  appropriately  with  respect  to  the 
initial  conditions  of  the  system. 

The  third  category  which  has  not  been  studied  as  extensively  as  the  first  two  is  the 
embedded  dynamic  neural  networks.  Embedded  dynamic  neural  networks  are  constructed 
by  utilizing  dynamic  neurons.  The  dynamic  neuron  structure  is  different  from  that  of  static 
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neuron  in  the  sense  that  in  the  former  one  or  more  dynamic  elements  are  utilized  to  obtain  a 
specific  dynamical  input-output  map.  Several  dynamic  neuron  structures  have  been  reported 
in  references  [76],  [77],  [78], [79].  In  [76]  a  spatio-temporal  neuron  was  introduced  in  which 
the  conventional  weight  multiplication  operation  was  replaced  by  a  linear  filtering  (an  all 
zero  filter)  operation.  Gamma  model  was  utilized  in  [77]  for  identification  of  nonlinear 
systems.  The  structure  of  the  Gamma  model  is  similar  to  the  tapped  delay  line  structure 
but  instead  of  using  simple  shift  elements  in  the  line,  a  first  order  linear  filter  is  utilized  to 
generate  a  dynamic  input-output  map.  In  [78]  a  dynamic  neural  processor  was  proposed 
based  on  the  physiological  fact  that  the  neural  activities  are  dependent  upon  the  interaction 
of  antagonistic  neural  sub-populations,  excitatory  and  inhibitory  activities.  The  well  known 
Time  Delay  Neural  Network  (TDNN)  was  introduced  in  [80]  for  phoneme  recognition.  In 
TDNN  each  weight  is  associated  with  a  delay.  The  adaptive  version  of  TDNN  was  utilized 
in  [79]  for  identifying  two  classes  of  nonlinear  systems  referred  to  as  “the  first”  and  “the 
fourth”  class  of  nonlinear  systems  [60] . 

In  [71] ,  a  neuro-dynamic  identifier  is  developed  by  using  a  dynamic  neural  network  with 
embedded  linear  adaptive  filters.  It  is  shown  that  by  utilizing  a  specific  type  of  dynamic 
neurons  the  simplest  proposed  structure  is  capable  of  representing  the  input-output  map  of 
a  class  of  nonlinear  systems  denoted  as  “the  first  class  of  nonlinear  systems”  in  [60].  The 
.  proposed  structure  was  also  modified  and  generalized  to  represent  the  input-output  map 
of  the  other  three  classes  of  nonlinear  systems.  For  the  DNN  structure  proposed  in  [71], 
learning  takes  place  by  adapting  the  embedded  linear  filter  parameters  as  well  as  the  neural 
network  weights.  The  adaptation  of  the  linear  filter  parameters  will  not  only  increase  the 
computational  complexity  of  the  DNN  but  also  the  risk  of  instability  of  the  filter  during  the 
learning  process. 

The  fourth  class  of  DNN  structures  that  is  proposed  in  [81]  [82]  consists  of  a  feed-forward 
static  neural  network  architecture  cascadede/followed  by  a  fixed  stable  linear  filter.  The 
authors  have  developed  the  proposed  DNN  for  stable  identification  of  unknown  nonlinear 
systems.  In  the  proposed  structure,  the  only  adaptive  parameters  of  the  DNN  during  the 
training/learning  process  are  the  neural  weights  and  the  parameters  of  the  stable  linear  filter 
remain  unchanged.  Furthermore,  a  novel  approach  has  also  been  proposed  for  the  weight 
update  mechanism  based  on  the  modification  of  the  well-known  back-propagation  (BP)  algo¬ 
rithm.  Figure  5.20  shows  the  original  structure  of  the  proposed  DNN  [82].  The  original  DNN 
structure  proposed  in  [81]  [82]  uses  continuous-time  filter  in  the  architecture.  In  our  proposed 
robust  FDI  scheme  depicted  in  Figure  5.18,  we  have  employed  the  same  DNN  architecture 
with  the  slight  modification  of  using  discrete-time  rather  than  of  a  continuous-time  stable 
linear  filter.  Correspondingly,  the  weight  update  laws  have  also  been  slightly  modified.  The 
two  motivations  behind  the  selection  of  such  DNN  architecture  are  ( i )  the  existence  of  a 
formal  and  analytical  stability  proof  for  the  overall  identification  system  using  Lyapunov’s 
direct  method,  and  (u)less  computational  and  analytical  complexity  of  the  training  process 
and  weight  update  mechanism  due  to  the  fact  that  the  filter  parameters  are  not  getting 
updated. 
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Figure  5.20:  Structure  of  the  selected  DNN 


5.5.2  Application  of  DNN  to  Identification  of  ALTAV  Modeling 
Uncertainties 

In  order  to  make  the  FDI  subsystem  with  respect  robust  to  modeling  uncertainties,  we 
require  to  compensate  only  the  impact  of  uncertainties  on  those  outputs  of  the  system 
that  are  used  as  inputs  to  the  FDI  subsystem.  Although  we  have  twelve  outputs  for  the 
ALTAV  platform,  however,  only  six  of  them,  namely  x,  7,  <p,  9, 7,  <p,  are  utilized  as  inputs  to 
the  nonlinear  geometric  FDI  subsystem.  On  the  other  hand,  we  observed  previously  that 
the  introduced  parameter  uncertainties  given  in  Table  5.2  only  force  the  5th  and  the  6th 
residuals,  namely  773,  r2 4,  to  go  out  of  threshold  bounds.  However,  careful  investigation 
of- the  observer  equations  given  in  equation  4.47  reveals  that  the  observers  generating  the 
residuals  7-13,  r2 4,  use  only  four  of  the  ALTAV  outputs,  namely  <p, 9, 7^.  So,  we  need  to 
identify  and  consequently  compensate  the  effect  of  modeling  uncertainties  only  on  these  four 
outputs. 

In  order  to  identify  the  effect  of  modeling  uncertainties  on  the  above-mentioned  four 
outputs  of  interest  using  DNN,  we  need  to  specify  first  the  inputs  to  the  DNN  structure. 
Analysis  of  the  ALTAV  dynamics  given  in  equation  4.35  reveals  that  the  two  outputs  7, 7 
are  decoupled  from  the  two  other  outputs  0, <p,  and  each  pair  corresponds  to  a  separate 
second-order  nonlinear  differential  equation.  Therefore,  we  require  two  DNN  structures  each 
identifying  the  modeling  uncertainties  effects  on  a  separate  pair  of  outputs.  The  structure 
of  these  two  DNNs  are  shown  in  Figure  5.21. 

5.5.3  DNN  Identifier  Equations  and  Update  Laws 

Consider  the  two  DNN  structures  in  Figure  5.21.  We  define  the  state  vector  for  each  DNN 
as  follows: 


Xud  [P/ud  7ud] 

(5.8) 

Xud  =  l^ud  ‘Pud] 

(5.9) 

Then,  by  defining  the  input  vectors  of  the  two  DNNs  as: 

s7(t)  =  [x?{t)  Fi(t)  F3(t)  xUt  - 

1)]T 

(5.10) 

^(t)  =  [xf(t)  F2(t)  F4(t)  x*d(t- 

1)]T 

(5.11) 

*L$o 

tco 


Figure  5.21:  Two  DNNs  each  identifying  modeling  uncertainties  for  a  pair  of  output  variables 
we  will  have  the  following  state-space  representation  for  the  dynamics  of  the  two  DNNs: 

=  WJt  - 1)  +  - 1),  a,  a)  (5.12) 

-  1)  +  -  1).  4 (<),  S,,  F4)  (513) 

where  Ay,  A#  are  the  Hurwitz  matrices  of  the  stable  linear  filters  of  the  two  DNNs  and  the 
nonlinear  functions  G7,  G^  are  the  nonlinear  mappings  of  the  feed-forward  neural  networks 
in  the  structure  of  each  DNN,  and  are  given  by: 

G7(x7)  =  fF7<j(F7x7)  (5.14) 

G*(x*)  =  W+a(V*x*)  (5.15) 

where  W,  V  are  the  weights  of  the  hidden  and  output  layers  of  the  feed-forward  network, 
respectively,  and  cr(.)  is  the  transfer/activation  function  of  the  hidden  neurons  that  is  usually 
considered  as  a  sigmoidal  function: 


(Ti(ViX) 


1  +  exp[—2Vix] 


where  Vi  is  the  ith  row  of  V,  and  a^Vx)  is  the  zth  element  of  the  vector  a(Vx). 


(5.16) 
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In  the  proposed  DNN  structure,  only  the  neural  weights  of  the  static  feed-forward  maps, 
namely  W1 ,  V7,  W*,  are  getting  updated.  The  update  of  the  weights  is  carried  out 
iteratively  using  a  modified  gradient  descent  algorithm  [82]  as  given  in  equations  5.17.  This 
general  formulation  of  the  update  laws  will  essentially  remain  the  same  for  the  output  weights 
V,  so  they  have  only  been  given  for  the  hidden  layer  weights,  namely  W.  However,  the 
derivation  of  partial  derivatives  will  be  different  for  the  hidden  and  output  weights,  which 
will  result  in  different  final  update  laws,  as  provided  in  equations  5.19. 


W(t  + 1)  =  W(i)  -  vl(g^)  -  A\\iiW(t) 

r)  7$ 

W*(t  +  1)  =  W*(t)  -  -  PtlNIW^W 


(5.17) 

(5.18) 


The  first  term  in  the  above  equations  is  the  back-propagation  (BP)  term  and  the  second  term 
is  the  e-modification  term.  Furthermore,  >  0  are  the  learning  rates,  p7 , are  small 

positive  numbers,  J7  =  and  P  =  Kxjx^)  are  the  objective  functions  associated 

to  each  DNN,  and  x1,  are  the  identification  errors  of  each  DNN  identifier.  Calculation  of 
the  partial  derivatives  will  result  in  the  following  update  laws  for  the  all  the  weights  of  the 
two  identifiers: 


W^it  +  1)  =  W\t)  -  p7(^(/  -  Ar)-1)T((r(V7z7))T  +  Pl\\x,\\w\t)  (5.19) 

F7(f  +  1)  =  V\t)  -  rjl (x^ (I  -  j47)_1W7(/  -  A(F7z7)))tzt  +  p7||x7||H7(t)  (5.20) 


W*(t  +  1)  =  W*{t)  -  izj(sj(/  -  A*)~1)T(a{V*x*))T  +  f&\\xt\\W*(t)  (5.21) 

V*{t  +  1)  =  V*(t)  -  rjtixl (I  -  A+y'W+V  -  A(F^)))txt  +  pt\\xt\\V*(t)  (5.22) 


5.6  Simulation  Results 

In  order  to  evaluate  the  effectiveness  of  the  proposed  robust  FDI  scheme  for  the  ALTAV 
platform,  we  first  require  to  identify  the  dynamics  of  modeling  uncertainties  through  a  train¬ 
ing  process  depicted  in  Figure  5.19.  Due  to  inaccessibility  of  an  actual  ALTAV  we  had  to 
represent  the  actual  ALTAV  with  the  nominal  model  of  the  ALTAV,  given  in  equation  4.35 
but  with  the  parameters  of  the  model  perturbed  from  their  nominal  values,  as  given  in  Tables 
5.1  and  5.2.  Furthermore,  a  circular  reference  trajectory  was  used  for  the  ALTAV  closed-loop 
operation. 

As  shown  in  Figure  5.21,  two  DNN  identifiers  were  used  each  consisting  of  a  one- hidden 
layer  feed-forward  neural  networks  with  6  neurons  in  the  input  and  8  neurons  in  the  hidden 
layers,  respectively.  The  values  of  the  other  parameters  of  the  two  DNN  identifiers  such  as 
the  learning  rates  and  state  transition  matrix  of  the  discrete-time  filter  are  given  in  below: 
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1)  DNN  parameter  values  for  identifying  the  effect  of  modeling  uncertainties  on  7,7: 


rg  =  rg  =  10~4 

Pl  =  pi  =  10~6 

A7  =  0.99/2x2 

2)  DNN  parameter  values  for  identifying  the  effect  of  modeling  uncertainties  on  <fi ,  </>: 

it  =  ^  =  10“5 

A  =  A  =  10-7 

=  0.99/2x2 
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Figure  5.22:  Cost  of  training  for  7 

The  training  was  performed  for  4800(sec)  of  closed-loop  operation  of  the  ALTAV,  however, 
the  learning  rates  were  set  to  zero,  i.e.  weight  adaptation  was  stopped  and  the  weights  were 
frozen,  at  tst0p  =  4300(sec).  Figures  5.22  and  5.23  show  the  cost  functions  for  the  two  DNNs. 
As  can  be  seen  from  the  figures,  the  cost  function  is  very  well  decreasing  over  time.  More 
importantly,  even  after  the  weight  update  was  stopped  ( tst0p  <  t  <  4800),  the  cost  functions 
remain  at  the  same  level  as  before  the  stop  time  (t  <  tstop),  which  is  an  indication  of  the 
success  of  the  training  process  of  DNNs  in  learning  the  modeling  uncertainties  effects. 

After  the  termination  of  the  training  process,  the  freezed  weights  of  the  DNNs  are  saved 
and  used  in  the  on-line  closed- loop  operation  of  the  ALTAV  with  robust  FDI  scheme  depicted 
in  Figure  5.18.  Then,  the  system  shown  in  Figure  5.18  was  ran  for  200(sec)  with  the  original 
rectangular  reference  trajectory  under  the  presence  of  modeling  uncertainties  and  absence  of 
faults.  Figures  5.25,  5.26,  5.28,  5.29,  5.31,  and  5.32  show  the  residuals  773,  r24  generated  by 
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Cost  function  during  learning  for  <|)  and  ^  compensator 


Figure  5.23:  Cost  of  training  for  <fi 

the  robust  FDI  scheme,  respectively.  It  can  be  seen  in  the  figures  that  even  in  the  presence 
of  modeling  uncertainties,  the  two  residuals  stay  within  their  threshold  bounds  except  for 
a  very  small  negligible  period  of  time  for  r2 4.  Thus,  no  false  alarms  are  generated  by  the 
robust  FDI  scheme  as  opposed  to  the  results  of  the  non-robust  FDI  scheme,  presented  in 
Figures  ??,  ??.  Therefore,  the  simulation  results  confirm  the  reliability  of  the  performance 
of  the  proposed  robust  FDI  scheme. 
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Figure  5.24:  All  compensated  residuals  in  training  scenario 


Compensated  residual  in  training  scenario 


Figure  5.25:  Compensated  residual  r13  in  training  scenario 


Figure  5.28:  Compensated  residual  r13  in  test  1  scenario 


Compensated  residual  in  test  1  scenario 


Figure  5.29:  Compensated  residual  r2 4  in  test  1  scenario 
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Figure  5.30:  All  compensated  residuals  in  test  2  scenario 


Figure  5.31:  Compensated  residual  ri3  in  test  2  scenario 


Chapter  6 

Cooperative  Rendezvous  of  UAVs 


6.1  Rendezvous  Cooperative  Control 

A  number  of  papers  ([33]  [83]  [84]  [85]  [5])  have  investigated  this  problem.  Their  techniques 
will  be  reviewed  here  and  will  be  applied  to  our  scenarios. 

6.1.1  Rendezvous  Scenarios 

Consider  a  scenario  where  a  group  of  M  unmanned  air  vehicles  (UAVs)  are  required  to 
transition  through  N  known  target  locations.  In  the  region  of  interest,  there  are  a  number 
of  threats,  some  known  a  priori ,  others  “pop  up,”  or  become  known  only  when  a  UAV 
maneuvers  into  their  proximity.  Suppose  that  to  maximize  the  probability  that  the  mission 
will  succeed,  it  is  desirable  to  have  multiple  UAVs  arrive  on  the  boundary  of  each  target’s 
radar  detection  region  simultaneously. 

The  scenario  can  be  decomposed  into  several  subproblems. 

(i)  Given  M  UAVs  with  N  targets,  assign  each  vehicle  to  a  target  such  that  each  target 
- has,  if  possible., _multiple_UAVs  assigned  to  it,  and  such  that  preference  is  given  _to_ 

high-priority  targets. 

(ii)  For  each  team  of  UAV’s  assigned  to  a  single  target,  determine  an  estimated  time  over 
target  (TOT)  that  ensures  simultaneous  intercept  and  that  is  feasible  for  each  UAV  on 
the  team.  . 

(iii)  For  each  UAV  with  velocity  constraints  v  6  [Vmin,  Vmax],  determine  a  path  (specified  via 
waypoints),  such  that  if  the  UAV  were  to  fly  along  straight-line  paths,  it  could  complete 
the  path  in  the  specified  TOT,  while  satisfying  the  given  velocity  constraints. 

(iv)  Transform  each  waypoint  path  into  a  feasible  trajectory  for  the  UAV.  By  feasible,  we 
mean  that  the  turning  rate  constraints  and  velocity  constraints  are  not  violated  along 
the  trajectory.  Also,  the  trajectory  should  have  the  same  TOT  as  the  path  specified 
by  waypoints. 

(v)  Develop  globally  asymptotically  stable  controllers  for  each  UAV,  such  that  the  UAVs 
track  their  specified  trajectory. 
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Please  be  noted  that  the  solution  proposed  by  Beard  and  McLain  ([5]  [83]  [84]  [85]  [33]) 
assumes  that  individual  UAVs  fly  at  different,  preassigned  altitudes  thereby  ensuring  collision 
'avoidance. 

In  this  project,  in  order  to  simplify  the  rendezvous  problem  and  concentrate  on  the  FDIR 
techniques  for  rendezvous  UAV  controls,  we  only  consider  that  there  are  only  a  number  of 
known  threats,  three  UAVs  and  one  target.  That  is,  the  all  three  vehicles  are  expected  to 
arrive  the  target  simultaneously  in  the  presence  of  a  number  of  known  threats.  As  a  result, 
the  subproblems  we  need  to  solve  in  this  project  is  (i)  coordinated  UAV  intercept,  (ii)  path 
planning,  (iii)  feasible  trajectory  generation,  and  (iv)  asymptotic  trajectory  following.  A 
-det'aiiedrschematicrof-the-system-architecture-for-a-single-UA:V-is-shown-in-F-rgure-6rl-7— At- 
the  lowest  level  of  the  architecture  is  the  physical  UAV.  In  Figure  6.1,  the  target  manager, 
path  planning,  and  intercept  manager  work  together  to  generate  waypoint  paths  for  the  UAV. 
The  path  planner  generates  a  specified  number  of  paths  from  the  specified  UAV  to  a  specific 
target.  The  path  planner  returns  in-formation  about  each  path,  namely,  the  estimated  fuel 
expenditure  and  the  estimated  threat  exposure.  Both  the  target  manager  and  the  intercept 
manager  make  calls  to  the  path  planner.  The  role  of  the  intercept  manager  is  to  ensure  that 
when  the  target  manager  assigns  multiple  UAVs  to  the  same  target,  they  arrive  on  the  radar 
detection  boundary  of  the  target  simultaneously. 

The  trajectory  generation  block  in  Figure  6.1  receives  a  set  of  waypoints,  which  specify 
the  desired  path  of  the  UAV.  The  role  of  the  trajectory  generator  is  to  generate  a  feasible 
time  trajectory  for  the  UAV.  By  feasible,  we  mean  that  in  the  absence  of  disturbances  and 
modeling  errors,  an  input  trajectory  causes  the  UAV  fly  the  trajectory  without  violating  its 
velocity  and  heading  rate  constraints. 

The  communication  manager  shown  in  Figure  6.1  facilitates  communication  between  dif¬ 
ferent  UAVs.  Each  UAV  implements  a  separate  target  manager,  intercept  manager,  and  path 
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Figure  6.2:  Threat-based  Voronoi  diagram  [5] 


planner.  Therefore,  the  decisions  reached  by  these  functional  blocks  must  be  synchronized 
among  the  different  UAVs. 

As  we  mentioned  previously,  in  this  project,  all  three  UAVs  are  expected  to  arrive  one 
target  simultaneously,  so  target  manager  will  not  be  investigated,  and  path  planner  and 
intercept  manager  techniques  will  be  reviewed  in  the  next  subsections. 


6.2  Path  Planner 

The  output  of  the  path  planner  is  a  set  of  waypoints  and  commanded  velocity  for  each 
vehicle.  Paths  from  the  initial  vehicle  location  to  the  target  location  are  derived  from  a 
k-best  paths  graph  search  of  a  Voronoi  diagram  that  is  constructed  from  the  known  threat 
locations  [86] .  Creating  the  Voronoi  diagram  entails  partitioning  the  region  of  interest  with 
n  threats  into  n  convex  polygons  or  cells.  Each  cell  contains  exactly  one  threat,  and  every 
location  within  a  given  cell  is  closer  to  its  associated  threat  than  to  any  other  threat.  By 
using  threat  locations  to  create  the  diagram,  the  resulting  Voronoi  polygon  edges  form  a  set 
of  lines  that  are  equidistant  from  the  closest  threats,  thereby  maximizing  their  distance  from 
the  closest  threats.  The  initial  and  target  locations  are  also  contained  within  cells  and  are 
connected  to  the  nodes  forming  the  cell.  Figure  6.2  shows  a  Voronoi  diagram  created  for  a 
set  of  threats,  UAV  location,  and  target  location. 

Each  edge  of  the  Voronoi  diagram  is  assigned  two  costs:  a  threat  cost  and  a  length  cost. 
Threat  costs  are  based  on  a  UAV’s  exposure  to  a  radar  located  at  the  threat.  Assuming 
that  the  UAV  radar  signature  is  uniform  in  all  directions  and  is  proportional  to  1/d4  (where 
d  is  the  distance  from  the  UAV  to  the  threat),  the  threat  cost  for  traveling  along  an  edge  is 
inversely  proportional  to  the  distance  to  the  fourth  power.  In  this  work,  the  threat  cost  was 
calculated  at  three  points  along  each  edge:  Li/ 6,  Li/ 2,  and  5 Li/6,  where  L*  is  the  length  of 
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edge  i.  The  threat  cost  associated  with  the  zth  edge  is  given  by  the  expression 


Ji 


threat,i 


OtLi 

~3~ 


£ 


1 


+ 


(6.1) 


where  N  is  the  total  number  of  threats,  is  the  distance  from  the  1/2  point  on  the  ith 

edge  to  the  j th  threat,  and  a  is  the  constant  scale  factor. 

To  include  the  path  length  as  part  of  the  cost,  the  length  cost  associated  with  each  edge 
is 

Jlength,i  =  Li  (6.2) 

The  total  cost  for  traveling  along  an  edge  comes  from  a  weighted  sum  of  the  threat  and 
length  costs 

Ji  K"Jlength,i  T  (1  ft)« Jthreat,i  (6-3) 

The  choice  of  k  between  0  and  1  gives  the  designer  flexibility  to  place  weight  on  exposure 
to  threats  or  fuel  expenditure  depending  on  the  particular  mission  scenario.  For  this  work, 
a  value  of  0.25  was  found  to  produce  paths  that  were  balanced  in  terms  of  threat  avoidance 
and  path  length. 

With  the  cost  determined  for  each  of  the  Voronoi  edges,  the  Voronoi  diagram  is  searched 
to  find  the  set  of  lowest-cost  candidate  paths  between  the  initial  UAV  location  and  the 
location  of  the  target.  The  graph  search  is  carried  out  using  a  k-best  paths  algorithm. 


6.3  Intercept  Manager 

In  the  provided  architecture,  the  vehicles  are  required  to  prosecute  their  target  simultane¬ 
ously  to  enhance  mission  effectiveness.  The  challenge  is  to  determine  the  best  TOT  specifi¬ 
cation  for  the  team  in  light  of  the  threat  scenario  and  dynamic  capabilities  of  the  vehicles.  . 
The  output  of  the  intercept  manager  is  a  velocity  and  a  set  of  waypoints  for  each  vehicle. 
Once  candidate  paths  have  been  determined  by  searching  the  Voronoi  graph,  it  remains  to 
select  which  path  each  UAV  should  fly.  Path  selection  should  result  in  minimal  collective 
threat  exposure  for  the  team  and  simultaneous  arrival  of  team  members  at  their  target. 

Candidate  paths  to  the  target  for  UAV  i  are  parameterized  by  the  waypoints  £*  and  the 
UAV  forward  speed  V-  TOT  for  each  UAV  is  function  of  the  speed  of  the  UAV  along  the 
selected  path:  TOT;  =  fju  Vz).  Similarly,  the  cost  (threat  and  fuel)  to  travel  along  any 
path  to  the  target  is  a  function  of  the  path  and  the  speed:  Ji  —  #(£j,  Vi).  To  choose  the  best 
TOT  for  the  team  in  a  cooperative  manner,  some  information  regarding  the  candidate  paths 
for  the  UAVs  must  be  exchanged.  Rather  than  passing  &  and  V  around  among  all  of  the 
UAVs,  a  more  efficient  parameterization  of  information,  called  the  coordination  function,  is 
used.  In  this  problem,  the  coordination  function  J  models  the  cost  to  UAV  i  of  achieving  a 
particular  TOT:  J  =  h(TOT).  The  coordination  function  is  determined  from  the  relations 
for  TOTj  and  Ji.  Based  on  the  candidate  paths  determined  from  the  Voronoi  diagram  and 
feasible  range  of  UAV  air  speeds,  the  feasible  TOT  range  for  each  UAV  on  the  team  can  also 
be  determined. 
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Figure  6.3:  Coordinate  functions  for  two  UAVs  [5] 


The  cost  Ji  is  given  by  a  linear  combination  of  threat  cost  and  fuel  cost: 

3i  =  (1  ^)3threat,i  T  ^3 fuel, i  (5-4) 

The  threat  cost  for  each  edge  of  a  path  from  a  threat  is  represented  by: 

1 


-  A  f1 

M  V  Js  , 


3threat 


:0  11^-  K-l  +S(Wj  -^-l))|| 


:ds 


(6.5) 


where  h  represents  the  threat’s  position,  and  s  G  [0, 1]  parameterizes  the  straight-line  path 
from  Wj_i  to  Wj.  A  closed- form  solution  to  this  integral  is  given  by 
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where 


a  = 


{k  -  Wj-! )T(Wj  -  Wj- 1) 


\\wj  ~  Wj-iir 

b  _  II  [IK  ~  Wj-iW2!  ~  K  ~  Wj-i)(v>j  ~  Wj-i)T]  (h  -  Wj-x) |1 

\\Wj  -  Wj-iW3 

The  fuel  cost  for  traversing  an  edge  is  calculated  based  on  the  assumption  that  fuel 
usage  is  proportional  to  aerodynamic  drag  force,  which  is  proportional  to  velocity  squared. 
Accordingly,  the  fuel  required  to  traverse  an  edge  of  a  waypoint  path  from  Wj-i  to  Wj  is! 
given  by 

rti 

3 fuel,i,j  /  f  dt  =  Cfuel  1/  (t  tj_i)  =  CfueiVi\\Wj  Wj — 1 1 1  (5-7) 

Jtj-i 
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where  Cfuei  >  0  is  a  constant. 

Coordination  function  information  for  two  UAVs  composing  a  team  is  shown  in  Figure 
6.3.  Note  that  each  candidate  path  produces  a  line  segment  in  the  plot. 

Coordinate  function  and  feasible  TOT  range  information  are  exchanged  among  vehicles 
to  enable  cooperative  path  planning.  At  the  team  level,  the  cooperative  planning  problem 
is  simplified  to  finding  TOT*  that  minimizes  the  collective  threat  exposure  of  the  team 

n 

TOT*  =  arg  min  j) 

i=  1 

.  From  Figure  6.3,  it  can  be  seen  that  this  optimization  results  in  a  team-optimal  value  of 
TOT*=160.5s.  TOT  is  called  the  coordination  variable.  By  requiring  that  individual  UAV 
match  the  team-optimal  value  of  the  coordination  variable  TOT*,  cooperation  is  ensured. 
Once  TOT*  has  been  determined,  each  UAV  must  determine  which  of  the  candidate  paths 
&  to  take  and  the  appropriate  flight  speed  Vt  so  that  its  own  threat  exposure  J%  =  /(£;,  K) 
is  minimize  and  the  TOT*  value  is  matched. 


6.4  Fault  Tolerant  Cooperative  Rendezvous  of  UAVs 

6.4.1  Motivations 

Stringent  health  and  safety  and  reliability  requirements  for  UAVs  have  made  fault  tolerance 
in  UAV  control  systems  quite  essential  and  critical.  In  presence  of  undesirable  effects  such 
as  faults  in  actuators,  control  surfaces,  or  sensors,  UAV  control  systems  must  autonomously 
respond  and  adapt  in  order  to  recover  from  such  faults.  In  particular,  for  a  team  of  UAVs 
cooperatively  fulfilling  a  mission,  e.g.  a  rendezvous  task,  if  any  of  UAVs  is  subjected  to  a 
fault  where  an  individual  UAV  and/or  the  supervisory/mission  controllers  are  not  equipped 
with  autonomous  fault  tolerant  capabilities,  stability  of  the  faulty  UAV  and  success  of  the 
mission  may  not  be  maintained  which  could  then  lead  to  mission  failure. 

Motivated  from  the  above,  there  is  an  increasing  demand  for  development  of  autonomous 
fault  diagnosis  and  reconfigurable  UAV  cooperative  control  strategies  that  are  robust  to. 
either  a  fault  or  gradual  performance  degradation  of  individual  team  members.  Consequently, 
recently  fault  tolerant  control  systems  have  been  investigated  in  multiple  UAVs  environment 
(Boskovic  et  al.  [38,  87]).  However,  most  of  these  work  have  focused  on  the  formation  flying 
problem.  In  other  words,  rendezvous  strategies  developed  thus  far  in  the  literature  do  not 
formally  address  health  and  safety  and  fault  diagnosis  issues  and  solutions. 

One  of  the  main  contributions  of  here  is  incorporation  of  faults  (more  specifically,  actuator 
faults)  in  the  UAVs  and  development  of  a  nonlinear  autonomous  fault  detection  and  isolation 
(FDI)  scheme  for  a  cooperative  rendezvous  control  problem.  Furthermore,  a  cooperative 
rendezvous  mission  re-planning  strategy  is  developed  that  is  initiated  as  soon  as  faults  are 
identified  in  UAVs  by  our  proposed  FDI  strategy.  This  will  ensure  that  the  rendezvous 
mission  objectives  are  satisfied,  at  least  partially,  even  in  presence  of  faults  or  performance 
degradations  in  any  of  the  individual  UAVs. 
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6.4.2  Problem  Statement 


To  facilitate  development  and  demonstration  of  a  fault  tolerant  cooperative  rendezvous  con¬ 
trol  problem  of  UAVs,  a  benchmark  scenario  is  formulated  by  utilizing  a  specific  type  of  a 
UAV  belonging  to  the  small  autonomous  unmanned  vehicles  known  as  Aerosonde.  Through 
this  benchmark,  we  consider  a  cooperative  rendezvous  control  problem  with  three  Aeroson- 
des  (UAVs)  and  a  single  target,  where  the  team  of  Aerosondes  are  required  to  simultaneously 
arrive  at  their  designated  target  in  presence  of  a  priori  known  threats  (distributed  over  a 
region  of  interest  (ROI))  despite  and  even  after  occurrence  of  faults  in  actuators  of  any  of 
the  individual  Aerosondes.  From  a  strategic  and  planning  perspective,  Aerosondes  are  re¬ 
quired  to  arrive  at  their  designated  target  simultaneously  in  order  to  increase  the  element  of 
surprise  and  decrease  the  risk  of  being  detected  by  threats  and  adversaries,  thus  maximizing 
the  probability  of  mission  success. 

The  FDI  subsystem  is  tasked  with  the  objective  of  detecting,  isolating,  and  identifying 
the  severity  of  the  presence  of  actuator  faults  that  can  cause  performance  degradations  in 
Aerosondes.  This  will  ensure  and  allow  the  rendezvous  re-planning  strategy  to  accommodate 
the  mission  and  avoid  its  failure. 

6.4.3  Aerosonde  FDI  Subsystem 

Development  of  a  fault  tolerant  cooperative  rendezvous  strategy  is  a  complex  problem  that 
requires  development  of  various  subsystems  and  functionalities  including  an  FDI  subsystem, 
cooperative  rendezvous  algorithms  (including  a  path  planning  algorithm  and  an  intercept 
manager),  and  a  re-planning  strategy  that  interfaces  the  FDI  subsystem  with  the  cooperative 
rendezvous  algorithms.  Each  of  these  subsystems  operate  at  a  different  level  of  abstraction. 
Thus,  we  deploy  a  hierarchical  system  structure  with  the  FDI  subsystem  operating  at  the 
lowest  level  (i.e. ,  individual  UAV  sensors  and  actuators)  and  cooperative  rendezvous  algo¬ 
rithms  at  the  highest,  as  shown  in  Figure  6.4.  Below,  we  will  first  investigate  and  develop  our 
proposed  strategies  and  solutions  for  each  subsystem  separately,  and  then  through  numerical 
simulation  results  demonstrate  and  illustrate  performance  capabilities  and  advantages  of  our 
developed  integrated  hierarchical  fault  tolerant  cooperative  rendezvous  scheme,  as  depicted 
in  Figure  6.4. 

Aerosonde  (Niculescu  [53])  is  a  small  autonomous  airplane  designed  for  long-range  weather 
data  acquisition.  It  was  developed  especially  for  reconnaissance  over  oceanic  and  remote  ar¬ 
eas,  and  in  harsh  conditions.  Its  low-cost  design  and  operational  flexibility  has  promoted  its 
use  for  a  wide  range  of  remote-sensing  applications.  In  this  section,  our  proposed  nonlinear 
geometric  FDI  strategy  will  be  applied  to  the  lateral  dynamics  of  the  Aerosonde.  In  this 
work  only  tho  taterai^motion  of  Aerosonde  wasnconsidered~andnyhich  is  provided-in-details- 
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Figure  6.4:  Fault  tolerant  rendezvous  architecture 


as  follows: 

mvVT  =  Ft  cos  / 3  -  ^pV^S  CD0  +  Cp  ■  Sa  +  C5p  •  5r 

mJVT  =  -FTsinP  +  \pV*S  C?  ■  (3  +  CsYa  •  50  +  C* r  • .  <Sr  +  (C£  •  p  +  CrY  ■  r)  -  mvVTr 

Z  Z  Vt 

r?  =  J,-\pVfsb  cf-p+c‘‘-6a  +  c‘''Sr  +  ^-(CTp+c;-r) 

+J„  •  i pVSSb  Ci-P  +  Ct  ■  S.  +  ct  ■  ST  +  ±ACi  .  p  +  crn  ■  r) 
rr  =  J„-\pV}Sb  Cf  ■0  +  Cf--S.  +  C‘'-Sr  +  ^r(CTp  +  C[-r) 

+J,  ■  IpVfSb  c^!3  +  c,n‘-5a  +  Csn'  ■  5r  +  —(Cl  ■  p  +  c;  .  r)  (6,8) 

where  Vt  is  the  airspeed,  P  is  the  side  slip  angle,  p  is  the  roll  angle  rate,  r  is  the  yaw  angle 
rate,  Ft  is  the  engine  thrust,  5a  is  the  aileron  angle,  Sr  is  the  rudder  angle,  p  is  the  air 
density,  S  is  the  wing  area,  b  is  the  wing  span,  Cm  is  the  minimum  drag,  C5p  and  C5£  are 
the  roll  and  yaw  control  derivatives  for  drag  force,  respectively,  Cy  is  the  sideslip  derivative, 
Cy  and  Cy  are  the  roll  and  yaw  control  derivatives  for  side  force,  respectively,  Cy  and  Cy 
are  the  roll  and  yaw  rate  derivatives  for  side  force,  respectively,  Cf  is  the  sideslip  derivative 
for  roll  momentum,  Cfa  and  Cfr  are  the  roll  and  yaw  control  derivatives  for  roll  momentum, 
respectively,  C?  and  CTn  are  the  roll  and  yaw  rate  derivatives  for  yaw  momentum,  respectively, 
C%  is  the  sideslip  derivative  for  roll  momentum,  C^  and  C^  are  the  roll  and  yaw  control 
derivatives  for  yaw  momentum,  respectively,  C%  and  Crn  are  the  roll  and  yaw  rate  derivatives 
for  yaw  momentum,  respectively,  Jx,  Jy,  Jz  and  Jxz  are  the  moment  of  inertia  and  mv  is  the 
mass  of  vehicle. 

Consider  the  state  vector  as  x  =  [Vt  P  p  r],  so  that  the  above  equations  can  be  written 


214 


in  a  compact  state  space  representation 

x  =  f(x)+g1{x)FT  +  g2(x)6a  +  g3(x)6r  (6.9) 

with  appropriate  definitions  for  the  functions  /,  gi(x),g2(x),  and  g3{x).  To  address  the  fault 
detection  and  isolation  problem  in  input  channels  of  the  above  Aerosonde  model  (equation 
(6.8)),  nonlinear  geometric  FDI  based  detection  filters  are  designed  (De  Persis  et  al.  [49]). 
Three  input  channels  aileron  5a  ,  rudder  Sr  and  throttle  Ft  are  used  for  controlling  the 
lateral  motion  of  the  Aerosondes.  Due  to  dynamics  of  the  Aerosonde,  we  have  shown  that 
(details  are  omitted  due  to  space  limitations)  it  is  not  possible  to  find  a  residual  that  is  just 
affected  by  one  channel  and  is  decoupled  from  other  channels.  Therefore,  a  set  of  three  novel 
detection  filters  are  designed  such  that  each  residual  is  decoupled  from  one  input  channel  and 
is  affected  by  two  other  channels.  By  applying  the  nonlinear  geometric  FDI  approach  that 
is  modified  according  to  the  above  observation,  the  following  new  set  of  states  are  obtained: 


zi  =  log(x  i)+x2^§-  (6.10) 

z2  =  log(x  i)+xS^  (6.11) 

Cy 

zz=p  (6.12) 

Z4  =  r  (6.13) 

The  next  step  is  to  design  nonlinear  observers  for  zx,.z2  and  z3  that  generate  the  estimated 
values  of  zly  z2  and  z3.  Finally,  the  residual  signals  are  determined  according  to 

ra  =  zi-£i  (6.14) 

xr  =  z2  -  z2  (6.15) 

rF  =  z3  -  z3  (6.16) 


Table  6.1  shows  our  decision  logic  for  determining  the  detection  and  isolation  of  a  given 
fault  occurring  in  one  Aerosonde.  By  observing  the  FDI  residuals  and  invoking  this  table,  one 
is  able  to  correctly  and  reliably  detect  Aerosonde  actuator  faults  and  identify  their  locations. 

Figures  6.5  and  6.6  show  the  performance  of  our  proposed  nonlinear  FDI  approach.  Figure 
6.5  depicts  the  response  of  the  Aerosonde  states  in  a  faulty  scenario  in  which  a  50%  loss  of 
effectiveness  engine  fault  has  occurred  at  50  seconds.  One  can  clearly  observe  that  after 
the  occurrence  of  this  fault,  the  Aerosonde  is  no  longer  able  in  achieving  the  commanded 
airspeed  (23m/s),  and  where  the  residuals  for  aileron  and  rudder  exceed  their  thresholds  as 
shown  in  Figure  6.6.  Therefore,  by  using  the  decision  logic  as  indicated  in  Table  6.1  and 
from  Figure  6.6,  the  FDI  scheme  has  successfully  identified  the  occurrence  of  the  engine  fault 
at  the  instant  50  seconds. 

6.4.4  Cooperative  Rendezvous  Re-planning 

In  order  to  facilitate  development  and  implementation  of  a  cooperative  rendezvous  control 
and  re-planning  strategy,  we  first  formally  state  the  general  cooperative  rendezvous  problem 
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Table  6.1:  Fault  detection  and  isolation  for  Aerosonde  UAV 


Threshold  exceeds 

Threshold  does  not  exceed 

Detected  fault 

ra 

rr,rF 

rudder  or  engine 

rr 

ra,rF 

aileron  or  engine 

rF 

ra,rr 

aileron  or  rudder 

rr,rF 

ra 

aileron 

ra,rF 

7> 

rudder 

ra,rr 

rF 

engine 

ra,  rat  rF 

~ 

concurrent  faults 
in  two  channels  or  more 

M  10  | - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - r 
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Figure  6.5:  Aerosonde  states  corresponding  to  a  50%  loss  of  effectiveness  fault  in  the  engine 

and  the  steps  required  for  its  implementation.  For  this  purpose,  consider  a  group  of  M 
unmanned  vehicles  (UAVs)  that  are  required  to  traverse  through  N  target  locations  starting 
from  completely  diverse  initial  positions  and  in  presence  of  threats  in  the  ROI.  The  threats 
can  in  general  be  known  a  priori,  be  ’’pop- up”,  or  become  known  when  a  UAV  arrives  close 
to  their  neighborhood. 

In  general,  the  cooperative  rendezvous  problem  can  be  decomposed  into  five  subproblems 
(Beard  et  al.  [33])  including  (1)  target  assignment,  (2)  intercept  management,  (3)  path 
planning,  (4)  trajectory  generation,  and  (5)  control.  However,  since  we  consider  a  cooperative 
rendezvous  scenario  with  a  single  target  and  in  presence  of  a  priori  known  threats  distributed 
over  the  area  of  interest  (AOI),  target  assignment  functionality  is  not  required.  In  this 
research,  we -will  mainly  focus  on  intercept  management  and  path  planning  functionalities 
and  develop  a  rendezvous  re-planning  strategy  including  intercept  and  path  re-planning  in 
the  event  that  faults  occur  in  actuators  of  individual  UAVs. 
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Figure  6.6:  Residuals  corresponding  to  a  50%  loss  of  effectiveness  fault  in  the  engine 

As  soon  as  a  fault  is  detected  and  isolated  in  the  actuators  of  any  individual  Aerosonde, 
the  severity  of  the  occurred  fault  will  be  calculated  and  determined.  Since  loss  of  effectiveness 
faults  in  the  actuators  are  considered,  by  severity  we  essentially  mean  the  percentage  of 
effectiveness  that  has  been  lost  in  the  actuator  due  to  the  occurrence  of  the  fault.  The  fault 
severity  value  can  then  be  utilized  for  obtaining  the  amount  of  performance  degradation  in 
the  faulty  Aerosonde.  Table  6.2  shows  the  amount  of  degradation  in  the  maximum  achievable 
speed  of  Aerosonde  for  different  fault  severities.  The  reason  for  providing  this  table  for  only 
the  Aerosonde  speed  is  that  the  feasible  speed  range/limits  is  a  critical  and  important  input 
to  the  path  planning  and  intercept  manager  algorithms,  and  thus  will  directly  affect  the 
optimal  TOT*  and  paths  to  the  target. 


Table  6.2:  Fault  effects 

on  the  Aerosonde  speed  limits 

Fault  severity 

(Loss  of  effectiveness  in  engine) 

Speed  limits  of  the  Aerosonde  (m/sec) 

0% 

18-32 

10% 

18  -  30.77 

20% 

18  -  29.48 

30% 

18  -  28.24 

40% 

18  -  26.65 

50% 

18  -  24.99 

60% 

18  -  23.64 

70% 

18  -  21.54 

80% 

18  -  19.48 
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In  conclusion,  once  a  fault  is  detected  and  isolated  and  its  severity  is  identified,  the 
re-planning  algorithm  will  determine  and  obtain  new  speed  constraints  using  the  look-up 
tables  that  are  given  in  Table  6.2.  Subsequently,  the  intercept  manager  and  path  planning 
algorithms  are  executed  using  the  newly  obtained  constraints  on  the  faulty  Aerosonde  speed. 
Therefore,  a  new  optimal  TOT*  and  a  new  set  of  optimal  paths  to  the  target  will  then  be 
generated.  Table  6.3  shows  how  loss  of  effectiveness  engine  faults  affect  the  optimal  TOT*. 
One  can  observe  that  with  increasing  the  severity  of  faults  the  team  optimal  TOT*  is  also 
increasing,  but  not  necessarily  in  a  linear  fashion. 


Table  6.3:  Fault  effect  on  optimal  TOT* 


Loss  of  effectiveness  in  engine 

0% 

10% 

40% 

50% 

60% 

70% 

80% 

Optimal  TOT*  (sec) 

561 

586 

612 

648 

691 

731 

886 

Simulation  Results 

In  this  section,  simulation  results  for  a  cooperative  rendezvous  path  planning  and  intercept 
manager  are  shown.  Three  simulation  scenarios  are  considered,  namely,  healthy  condition, 
50%  loss  of  effectiveness  and  80%  loss  of  effectiveness.  Figures  6.7,  6.8  and  6.9  depict  the 
4  best  candidate  paths  for  the  three  Aerosondes  in  a  healthy  condition,  respectively.  These 
paths  are  then  considered  in  order  to  generate  coordination  functions  with  nominal  speed 
limits  of  the  Aerosonde  (18-32  m/s),  which  is  shown  in  Figure  6.10.  Consequently,  the 
team  optimal  TOT*  is  determined,  which  leads  to  the  cooperative  rendezvous  paths  for  all 
Aerosonde  as  shown  in  Figure  6.11.  Furthermore,  the  effects  of  the  faults  on  rendezvous  path 
planning  and  intercept  manager  are  investigated.  Figures  6.12  and  6.13  depict  coordination 
function  of  Aerosondes  in  case  of  50%  loss  of  effectiveness  faults  in  engines,  and  Figures 
6.12  and  6.13  show  the  scenario  of  80%  loss  of  effectiveness.  One  can  observe  that  due  to 
existence  of  faults,  not  only  the  optimal  team  TOT*  changes,  but  also  the  optimal  paths  for 
Aerosondes  need  to  be  changed  correspondingly. 


6.5  Remarks 

In  this  research,  we  have  developed  a  fault  tolerant  cooperative  control  scheme  for  UAV 
rendezvous  problem.  First,  a  nonlinear  geometric  FDI  subsystem  was  developed  that  can 
detect  and  isolate  faults  in  actuators  of  an  unmanned  Aerosonde  aerial  vehicle  including 
engine  thrusters  (throttle)  and  control  surfaces  such  as  aileron  and  rudder.  A  novel  fault 
isolation  logic  was  developed  based  on  different  combinations  of  fault  indicators  that  are 
known  as  residuals.  The  simulation  results  have  shown  the  effectiveness  and  utility  of  our 
developed  FDI  scheme. 

A  cooperative  rendezvous  planning  algorithm  was  also  implemented  that  ensures  simul¬ 
taneous  arrival  of  UAVs  at  their  designated  target.  Furthermore,  a  rendezvous  re-planning 
strategy  was  proposed  and  developed  that  provides  a  cooperative  rendezvous  algorithm  with 
new  constraints  on  Aerosondes’  velocities  (resulting  from  performance  degradations  due  to 
faults)  as  soon  as  faults  in  their  engine  thrusters  are  detected  and  identified  by  the  FDI 
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Figure  6.7:  The  best  paths  of  Aerosonde  1  under  healthy  condition 
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Figure  6.8:  The  best  paths  of  Aerosonde  2  under  healthy  condition 
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Figure  6.10:  Cost  functions  for  all  the  three  Figure  6.11:  Optimal  paths  for  the  three 
healthy  Aerosondes  healthy  Aerosondes  with  synchronized  TOT 

subsystem.  Consequently,  a  new  set  of  optimal  paths  to  target  and  command  velocities  are 
generated  for  each  Aerosonde  to  guarantee  UAVs  intercept  at  the  designated  target  despite 
presence  of  Aerosonde  significant  performance  degradations  due  to  engine  thruster  faults. 
Finally,  we  have  integrated  our  proposed  and  developed  FDI  subsystem,  the  cooperative 
rendezvous  planning  algorithm,  and  our  developed  rendezvous  re-planning  strategy  into  a 


220 


500  BOO  700  800  900  1000  1 1  □□  1200  "u-°  u  U-D  1 

Ti  me  over  tar  get  ( s)  x(m)  x  1 04 

Figure  6.12:  Cost  functions  for  all  the  three  Figure  6.13:  Optimal  paths  for  the  three 
Aerosondes  when  engines  lose  50%  of  effective-  Aerosondes  with  synchronized  TOT  when  en- 
ness  gines  lose  50%  of  effectiveness 


Figure  6.14:  Cost  functions  for  all  the  three  Figure  6.15:  Optimal  paths  for  the  three 
Aerosondes  when  engines  lose  80%  of  effective-  Aerosondes  with  synchronized  TOT  when  en- 
ness  gines  lose  80%  of  effectiveness 

hierarchical  fault  tolerant  cooperative  rendezvous  scheme.  Simulation  results  have  illustrated 
and  demonstrated  the  effectiveness  of  our  proposed  scheme. 


Chapter  7 

Conclusions  and  Future  Work 


In  this  project,  we  have  solved  the  problem  of  fault  detection,  isolation  and  recovery  for 
unmanned  systems.  The  developed  techniques  have  been  applied  to  fault  diagnosis  in  three 
UAV  platforms  including  Almost  Lighter  Than  Air  Vehicles  (ALTAV),  Aerosonde  and  F16 
fixed-wing  aircraft.  The  developed  FD I  scheme  can  be  broken  to  two  major  subsystems. 
One  is  the  model-based  fault  detection  and  isolation  subsystem,  which  has  been  developed 
using  nonlinear  geometric  FDI  approach  and  the  other  is  a  robustifying  module  that  is  im¬ 
plemented  by  learning-based  methodologies,  namely  neural  networks. 

Using  the  nonlinear  geometric  FDI  approach  we  have  been  able  to  detect  and  identify 
the  occurrence  of  four  types  of  fault  including  float,  lock  in  place,  loss  of  effectiveness,  and 
hard  over  failure  in  the  actuators  of  the  UAV.  Furthermore,  the  proposed  scheme  is  capable 
of  isolating  the  faulty  actuator  among  the  input  channels.  Moreover,  the  numerous  simula¬ 
tion  results  have  demonstrated  the  effectiveness  of  the  algorithm  in  detecting  and  isolating 
possible  presence  of  concurrent  faults  in  the  system. 

Due  to  the  model-based  nature  of  the  geometric  FDI  approach  and  in  order  to  make  the 
FDI  scheme  robust  to  modeling  uncertainties,  a  hybrid  framework  has  been  developed  that 
employs  neural  networks  capabilities  in  learning  unknown  nonlinear  dynamic  uncertainties. 
Using  the  dynamic  neural  networks  in  conjunction  with  the  highly  efficient  model-based 
geometric  FDI,  we  have  been  able  to  detect,  isolate,  and  identify  the  nature  and  the  loca¬ 
tion  of  the  faults  in  the  UAV  even  in  the  presence  of  modeling  uncertainties  and  disturbances. 

In  order  to  investigate  the  FDIR  for  team  of  UAVs,  we  have  considered  and  developed 
two  cooperative  strategies.  One  was  the  formation  flying  of  ALTAV  and  the  other  was  the 
cooperative  rendezvous  problem  for  fixed-wing  aircraft.  Within  the  formation  flying  context, 
we  have  developed  a  recovery  strategy  that  leads  the  faulty  ALTAV  in  the  formation  to  a 
safe  mode  of  operation.  As  far  as  the  rendezvous  problem  is  concerned,  we  have  designed 
and  implemented  optimal  path  planning  and  intercept  management  algorithms  that  allow 
the  fixed-wing  UAVs  to  simultaneously  arrive  at  a  specified  target  even  in  the  presence  of 
threats.  We  have  also  designed  a  mission  recovery  technique  for  the  rendezvous  problem. 
In  the  proposed  solution,  as  soon  as  a  fault  is  detected  and  identified  in  any  of  the  UAVs 
in  the  rendezvous  mission,  new  trajectories  are  assigned  to  each  UAV  based  on  the  newly 
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imposed  constraints  due  to  the  faults.  The  new  trajectories  are  calculated  using  an  optimal 
path  replanning  strategy. 

The  results  presented  in  this  project  have  raised  many  other  scientific  and  technological 
issues  that  need  to  be  further  investigated  and  explored  in  future. 

In  the  context  of  single  UAV  fault  diagnosis,  model-based  FDI  results  need  to  be  ex¬ 
tended  to  the  faults  in  sensors  and  system  components  other  than  actuators.  Furthermore, 
formal  analytical  derivations  need  to  be  explored  for  the  performance  characteristics  of  the 
proposed  robust  FDI  scheme.  Moreover,  in  order  to  fully  verify  the  effectiveness  of  the 
robustifying  scheme,  it  should  be  applied  to  other  UAV  platforms.  The  extension  of  the 
robustifying  scheme  to  sensor  and  component  faults  should  also  be  investigated.  To  achieve 
full  autonomous  fault  tolerant  capabilities,  more  advanced  adaptive  intelligent  recovery  tech¬ 
niques  should  be  developed  that  can  optimally  recover  each  single  UAV  from  faults  in  the 
actuators,  sensors  and  system  components. 

On  the  other  hand,  FDIR  research  within  the  mission  level  of  the  cooperative  control  of 
a  team  of  UAVs  is  very  much  in  its  infancy.  The  rendezvous  mission  and  formation  flying 
recovery  techniques  that  we  have  developed  in  this  project  need  further  improvements  to 
satisfy  the  stringent  requirements  of  a  practical  UAV  cooperative  control  problem.  Further¬ 
more,  they  should  be  extended  to  handle  the  possible  presence  of  information  flow  faults 
between  the  team  members.  Generalization  of  the  proposed  FDIR  techniques  to  other  types 
of  cooperative  missions  such  as  reconnaissance  and  surveillance,  to  name  a  few,  should  also 
be  considered.  This  will  make  the  FDIR  techniques  mission  independent. 
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